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ABSTRACT 


This  report  presents  the  results  of  fundamental  investigations  on  a 
variety  of  topics  related  to  the  optimization  of  analog  and  digital  data  communi¬ 
cation  systems.  The  maximum  likelihood  estimation  of  FM  modulated  signals 
is  investigated.  A  study  is  made  of  the  threshold  phenomenon  in  FM  reception 
with  an  ideal  discriminator  and  a  postdetection  Wiener  filter  for  the  case  of  a 
random  modulation  function.  Information  theory  is  applied  to  establish  bounds 
on  the  performance  of  analog  communications*  systems.  The  performance  o 
PCM  systems  for  transmitting  analog  information  is  investigated  and  compared 
with  theoretical  bounds  for  systems  of  prescribed  complexity.  Previous  work 
on  the  partial  ordering  of  digital  channels  by  the  criterion  of  inclusion  has 
been  extended.  The  analysis  of  the  optimization  of  N-ary  digital  systems 
operating  over  a  dispersive  channel,  which  was  begun  during  a  previous  phase 
of  the  contract,  is  further  advanced. 
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SUMMARY 


This  report  presents  the  results  obtained  during  the  third  phase 
of  fundamental  investigations  in  several  areas  related  to  the  transmission 
of  analog  and  digital  data.  While  the  previous  two  phdses  were  devoted 
solely  to  digital  techniques,  the  present  phase  is  concerned  primarily 
with  the  optimization  of  analog  demodulation  techniques. 

The  various  investigations  are  reported  in  six  chapters  in  accordance 
with  the  division  of  the  technical  effort  as  follows. 

Chapter  II  reports  the  results  of  an  investigation  of  the  maximum 
likelihood  estimation  of  FM  modulated  signals.  The  integral  equations 
which  describe  the  maximum  likelihood  estimation  process  are  developed. 

The  mean  square  error  between  the  maximum  likelihood  estimate  and  the 
original  modulating  signal,  valid  above  threshold,  are  obtained  aiid  compared 
with  the  mean  square  error  obtained  when  using  a  receiver  consisting  of 
an  ideal  descriminator  followed  by  a  Wiener  postdetection  filter. 

Chapter  III  is  devoted  to  an  investigation  of  the  threshold  ■*!.  ^ienon 
in  the  reception  of  FM  signals  by  a  receiver  consisting  of  an  idea! 
criminator  and  a  postdetection  Wiener  filter  for  the  case  when  thw  modulating 
function  is  a  random  variable. 

In  Chapter  IV  the  applic=i'*vn  of  information  theory  to  establish 
bounds  on  the  performance  of  analog  communication  systems  is  discussed. 

The  performance  of  PCM  systems  for  transmitting  analog  informa¬ 
tion  over  a  digital  channel  is  investigated  in  Chapter  V  and  compared  against 
bounds  on  the  performance  attainable  with  systems  of  a  prescribed  complexity. 

Chapter  VI  extends  the  work  developed  in  the  Phase,  2  report  ort' the 
partial  ordering  of  channels  by  thfe  criterion  of  inclusion.  This  criterion 
is  applied  to  resolve  a  paradox  observed  in  the  comparison  of  certain  .N-ary 
symmetric  channels. 

Chapter  VII  extends  the  analysis  of  the  optimization  of  N-ary  digital 
systems  operating  over  a  dispersive  channel  which  was  begun  in  the 
Phase  2  report.  Relationships  between  the  transmitted  waveforms,  the 
channel  transfer  function,  the  spectrum  of  the  noise,  and  the  receiver 
response  function  are  developed. 

Based  on  the  results  of  this  research  effort,  a  number  of  recommenda¬ 
tions  for  further  investigations  in  areas  related  to  this  work  are  presented. 
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INTRODUCTION 
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The  present  report  covers  the  third  phase  of  investigations  of 
digital  and  analog  communication  systems  which  have  been  performed  by 
Cornell  Aeronautical  Laboratory  during  the  period  January  1962  through 
February  1963,  under  Contract  No.  AF  30(602)-2210.  The  objective  of 
this  program  is  to  conduct  a  variety  of  fundamental  investigations  for 
the  purpose  of  assisting  the  U.  S.  Air  Force  in  the  development  of  advanced 
communication  systems.  The  investigations  are  not  aimed  at  the  synthesis 
or  analysis  of  any  particular  communication  system  but,  rather,  at  uncover¬ 
ing  the  characteristics  which  govern  the  behavior  of  various  methods  of 
communication.  The  entire  effort  covered  by  this  report  was  analytic  in 
nature.  While  the  first  and  second  phases  of  this  contract  were  solely 
concerned  with  digital  communication  systems,  the  third  phase  was  pri¬ 
marily  concerned  with  analog  systems;  however,  some  of  our  previous 
work  on  digital  systems  has  been  extended. 

This  report  is  organized  into  seven  chapters,  each  of  which  treats 
a  particular  topic  in  sufficient  completeness  so  that  it  may  be  read  inde¬ 
pendently.  Chapters  II  and  III  are  concerned  with  reception  of  randomly 
modulated  FM  signals.  Chapter  II  is  devoted  to  maximum  likelihood 
estimation  of  FM-modulated  signals.  The  maximum  likelihood  estimate 
is  the  a  posteriori  (i.  e.  ,  after  observation  of  the  received  waveform) 
most  likely  estimate  of  the  modulating  signal.  The  integral  equations 
which  the  maximum  likelihood  estimate  must  obey  are  developed.  Expres¬ 
sions  for  the  mean  square  error  between  the  maximum  likelihood  estimate 
and  the  original  modulating  signal  valid  above  threshold  are  developed 
and  compared  with  the  mean  square  error  obtained  by  means  of  a  receiver 
consisting  of  an  ideal  discriminator  followed  by  an  optimum  (Wiener) 
linear  post-discriminator  filter.  Chapter  III  is  devoted  to  an  investigation 
of  the  threshold  phenomenon  in  the  reception  of  randomly  FM-modulated 
signals  by  means  of  the  ideal  discriminator -Wiener  filter  receiver. 

Chapter  IV  is  devoted  to  a  discussion  of  the  application  of  informa¬ 
tion  theory  to  bound  the  performance  of  analog  communications  systems. 

It  is  shown  that  it  is  not  generally  possible  to  specify  a  maximum  attain¬ 
able  output  signal-to-noise  ratio  in  terms  of  the  available  channel  capacity; 
however,  it  is  possible  to  bound  the  maximum  attainable  ratio  of  signal" 
entropy  power  to  mean  square  error  between  the  input  and  output  signals. 

In  Chapter  V  the  performance  of  PCM  systems  for  transmitting 
analog  data  over  a  digital  channel  is  investigated.  Two  forms  of  binary 
PCM  systems  are  evaluated  in  terms  of  analog  signal-to-noise  ratios 
which  are  obtained  as  a  function  of  the  digital  error  probabilities.  Then 
the  performance  of  these  systems  is  compared  against  theoretical  bounds 
on  the  error  rate  performance  obtainable  with  digital  systems  of  a  speci¬ 
fied  complexity. 
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Chapter  VI  extends  the  results  on  the  partial  ordering  of  channels 
by  the  criterion  of  inclusion  which  was  developed  in  the  Phase  2  report. 

This  criterion  is  then  applied  to  resolve  a  paradox  observed  in  the  compari¬ 
son  of  certain  N-ary  symmetric  channels. 

Chapter  VII  continues  the  analysis  of  optimization  of  N-ary  digital 
systems  operating  over  a  dispersive  channel  which  was  originated  in  the 
Phase  2  report.  While  optimization  directly  in  the  time  domain  was 
attempted  in  the  Phase  2  report,  the  corresponding  conditions  which  must 
hold  in  the  frequency  domain  are  developed  here.  Relationships  among 
the  transmitted  waveforms,  the  channel  transfer  function,  the  spectrum 
of  the  noise,  and  the  receiver  response  function,  which  must  hold  in  an 
optimum  system  are  developed. 
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II 

MAXIMUM  LIKELIHOOD  RECEPTION  OF  FM  SIGNALS 

SUMMARY 

In  th±6  chapter  the  application  of  the  method  of  maximum  likelihood  to 
the  estimation  of  intelligence  transmitted  via  frequency  modulation  is  examined. 
Use  of  this  method  for  purposes  of  demodulation  was  first  described  by  YoulP^ 
but  in  the  past  has  been  applied  only  to  modulating  systems  "without  memory", 
that  is,  to  systems  such  as  AM  or  PM  where  the  present  value  of  the  trans¬ 
mitted  signal  is  a  function  of  the  present  value  but  not  the  past  of  the 
modulating  signal.  It  is  shown  that  this  method  can  also  be  applied  to 
modulating  systems  "with  memory"  such  as  FM  to  yield  a  pair  of  nonlinear 
integral  equations,  the  solution  of  which  specifies  the  a  posteriori  most 
likely  estimate  a*C^)  of  the  modulating  signal  a(V)  . 

-ft 

If  one  assumes  that  the  noise  is  additive  whit.-  and  gaussian  ,  the 
solution  of  one  of  the  integral  equations  becomes  obvious.  The  other  equa¬ 
tion  is  then  simplified  by  assuming  that  the  carrier  frequency  is  large 
compared  to  the  bandwidth  of  the  intelligence.  It  is  then  further  assumed 
that  for  sufficiently  large  signal- to-noise  ratios  the  error,  i.e.,  the 
difference  between  the  actual  intelligence  a(t)  and  the  maximum  likelihood 
estimate  ol*(t)  goes  to  zero  in  a  manner  which  permits  linearization  of  the 
remaining  integral  equation. 

The  linearised  integral  equation  may  be  solved  by  the  use  of  a  Green's 
function.  The  function  obtained  as  the  solution  of  the  maximum  likelihood 
problem  differs  from  the  modulating  signal  for  two  distinct  reasons.  First, 
because  the  "design"  is  based  on  the  assumption  that  a  certain  noise  level 
will  be  encountered)  the  output  is  distorted,  even  in  the  absence  of  any 
noise I  (We  are  in  the  position  of  having  taken  statistically  optimum  measures 
to  coirbat  noise  and  then  by  chance  having  received  no  noise.)  Secondly,  the 
output  contains  a  random  component  due  to  the  random  noise  actually  encountered. 
The  mean  square  difference  between  the  modulating  signal  and  the  demodulated 
output  consists  of  two  statistically  independent  terms  corresponding  to  these 

-ft 

The  assumption  of  white  gaussian  noise  is  largely  motivated  by  reasons  of 
mathematical  expediency. 
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effects.  The  mean  square  error  is  a  function  of  time  r  in  the  observation 
interval  V-  T  <  X  t  as  one  would  expect.  Expressions  for  the  mean 
square  error  are  derived  for  the  zero  delay  case  (  T  *t)  and  the 

infinite  delay  case(  T-t  +T)  -*■  oo,  (t  -  T)  oo  and  collared  with 
similar  expressions  derived  for  more- conventional  FM  receivers. 

In  deriving  the  integral  equations  which  determine  the  maximum  likeli¬ 
hood  estimate,  one  must,  of  course,  use  all  available  statistical  data.  It 
was  assumed  that  these  data  consist  of  the  autocorrelation  functions  of  the 
modulating  signal  and  the  additive  noise  and  that  all  other  parameters  are 
known.  However,  it  may  happen  that  certain  parameters  differ  from  the  assumed 
known  values.  In  order  to  investigate  the  effect  of  such  unsuspected  param¬ 
eter  variations,  the  dependence  of  the  mean  square  error  on  variation  of 
received  signal  and  noise  strength  and  signal  phase  has  been  computed.  It 
is  particularly  noted  that  the  effects  of  an  initial  carrier  phase  error  are 
attenuated  exponentially.  For  purposes  of  comparison  the  mean  square  error 
obtained  by  means  of  a  simplified  analytical  model,  valid  at  high  signal- 
to-noise  ratios,  of  a  conventional  FM  discriminator  followed  by  an  optimum 
(Wiener)  filter  are  computed.  When  operating  under  design  conditions  the 
expressions  obtained  for  this  case  are  identical  to  those  obtained  for  the 
maximum  likelihood  reception;  however,  the  sensitivity  to  deviation  from 
design  conditions  differ. 
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INTRODUCTION 


The  basic  reception  problem  of  communication  is  to  obtain  at  the  receiver 
the  "best"  estimate  of  the  transmitted  intelligence*  In  order  to  keep  the 
discussion  within  the  area  of  communications  engineering,  we  identify  intelli¬ 
gence  with  the  modulating  waveform  produced  at  the  transmitter  by  the  source 
of  intelligence.  The  data  on  which  this  estimate  is  to  be  based  consists  of 
a  finite  length  record  of  the  received  waveform  and  knowledge  of  the  type  of 
modulation  used  at  the  transmitter,  the  statistics  of  the  intelligence  source, 
and  the  characteristics  of  the  communications  channel.  In  the  simplest  case 
of  practical  interest  the  channel  is  assumed  to  merely  add  independent  noise 
to  the  transmitted  waveform. 

It  is  to  be  noted  that  the  problem  as  stated  above  seeks  the  best  estimate 
of  the  modulating  intelligence  directly  from  the  received  modulated  waveform. 
Various  definitions  of  best  can  be  employed  and  will,  in  general,  lead  to 
different  estimates.  The  maximum  likelihood  solution  provides  the  a  posteriori 
(after  utilization  of  all  available  data)  most  likely  estimate  of  the  modulating 
signal.  The  theory  of  maximum  likelihood  reception  was  first  presented  by 
Toularl  In  that  paper  it  is  indicated  that  the  theory  can  be  applied  to  ampli¬ 
tude  and  phase  modulated  systems,  and  the  case  of  amplitude  modulation  is 
treated  in  some  detail.  In  this  paper  the  application  of  this  theory  to  fre¬ 
quency  modulated  systems  will  be  developed.  As  far  as  application  of  Toula's 
theory  is  concerned,  the  most  inportant  difference  between  frequency  modula¬ 
tion  and  amplitude  or  phase  modulation  is  that  with  FM  the  present  value  of 
the  transmitted  waveform  depends  on  the  past  history  as  well  as  upon  the  present 
value  of  the  modulating  intelligence. 
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MAXIMUM  LIKELIHOOD  EM  DEMODULATION 
1)  Derivation  of  Governing  Integral  Equations 

The  system  under  consideration  is  shown  in  Figure  1. 


a(r)- 


FM 

MODULATOR. 


Zz  [Tjd(r)] 


DEMODULATOR 


e,fr) » ez\z,a.(z)]  *n( t) 


n(z) 


•  FIGURE  1 

Our  aim  is  to  develop  a  demodulator  which  produces  as  its  output  a  function 
which  is  the  most  probable  estimate  of  a(r)  ,  evaluated  at  time  t  ,  given 
the  information  from  the  preceding  T  seconds  where  t  -  T  4  T  4  t  .  We 
define  the  function  a.  *(t,  t )  as  the  most  probable  cl(Z)  ,  giVAn  the 
input  e,(T)  during  the  interval  t -T4T4  t  *.  For  FM  we  have 

e2  [r,  a(rj\  =  E0  sin  [uj0T +, 0  /  a(u)du--h<f\  j  t-T 4V 4  t 

«4  -T 

where  <p  represents  the  unknown  carrier  phase  at  T-  t  -  T ,  the  start  of  the 
observation  period. 

We  will  assume  that  both  the  intelligence  a(v)  and  the  noise  n(v) 
are  gaussian  processes  with  zero  mean  and  continuous  covariance  functions 
($  >  T~)  and  R ^  (s  ,7)  . 

Then  a(r)  and  n(V)  may  be  expanded  in  a  Karhunen-Loeve  expansion, 
as  follow^* % 


*The  notation  <£(c,t)  is  used  to  emphasize  the  dependence  of  a*(  )  on  both  r,  t 
In  particular,  we  shall  later  compute  some  properties  of  a  (t,  t)  . 


(1) 
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(2) 


a(v) 


tt°°  AibM 

2-.  # — nr 


t-r<  r<  t 


n(r) 


N;  tyj  (r) 
/*<  ,/z 


t-T<r<  t  (3) 


where  the  A[  ,  N;  are  Independent  gaussianly  distributed  variables  with 
zero  mean  and  unity  variance,  and 


<P;(r) 


-  X;/, 

Jt-T 


f;(r)  -  ,*,■  /' *n(r,VVi(S)<*S 

Jt-T 


(U) 

(?) 


The  4>i(t)  and  the  ^(T)  form  two  complete  orthonormal  sets  in  the  interval 
t  -T  4  'f  4  t  .  Upon  the  receipt  of  the  waveform  e,(r)  ,  the  ideal  receiver 
can  do  no  more  than  to  confute  the  a  posteriori  probability  density  of  all 
possible  intelligence  signals  p\a(r) This  is,  however,  not  the 
output  one  desires  from  a  receiver}  what  is  desired  is  a  single  function  a.*(T,  t) 
which  is,  in  some  sense,  the  best  estimate  of  et(t')  ,  given  the  values  of 
et(v)  over  the  interval  t  -  T  <  T  4  t  ,  The  method  of  maximum  likelihood 
chooses  a*(r,  t)  such  that  f>  \cf(T,  t)\  ef(T)^  is  maxindzed.  This  is  certainly 
a  reasonable  criterion,  but  one  should  bear  in  mind  that  it  is  not  the  only 
reasonable  criterion  of  optimality.  Using  Bayes'  rule,  we  have 


where 


■p(a.)  -  probability  density  of  a(T) 

■p(a\ef)  -  conditional  density  of  a(r)  given  et(v) 
p(ef  |  a.)  -  conditional  density  of  et(V)  given  a  (t) 
f>(et)  -  probability  density  of  ef(zj 
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The  integral  of  a  probability  density  over  the  entire  sample  space  (e.g., 
over  all  possible  realizations  of  the  waveform)  must  be  unity.  For  a  particular 
received  waveform  e,  (T)  ,  p(e1)  is  a  constant,  such  that  p(o.\gi)  as  given 
by  Equation  (6)  satisfies  this  normalization. 

We  now  seek  to  express  Equation  (6)  in  ten  s  of  the  coordinates  | A 
and  |/V/j  .  The  a  posteriori  aost  probable  signal  a*(T,  t)  is  then  determined 
by  specification  of  the  a  posteriori  aost  probable  set  [A;*]  • 

The  a  priori  probability  densities  of  the  first  K  coordinates  of 
{Ai  }  and  [Ni]  are 


The  conditional  probability  density  p(et\a)  is  the  probability  density  of 
the  noise  evaluated  at  n(r)  •  e1(v)-ei  [V,  a.(r)J  .  Using  Equation  (3),  the 
coordinates  are 


Ni  -  A 


/zj ^  £e,(r)-*2\r,*(rj\j  %(v)dr -m/2 t>L 


Substituting  Equations  (7) ,  (8)  and  (9)  into  Equation  (6)  yields 


(9) 


f>K(a\ei)  =  CK  ezp  ~yYL.  (10) 

i  =  l 

where  CK  is  a  normalizing  constant. 


The  set  (  A*kj(-  j  which  maximizes  f>K(a\e,)  may  be  found  by  differentiat¬ 
ing  Equation  (10)  with  respect  to  each  Ar  and  requiring  that  all  the  deriva¬ 
tives  vanish.  We  shall  assume  that 


-Z?. /<n!%(r> 

i=1  At 


t-T4T4t  (11) 
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converges  in  the  mean  to  the  true  maximum-likelihood  estimate  a* (f,t) .  We 
find  then 

for  Ar  *  A*{K)r  > 


SS  A*  X. '  ^  /  9 

0  “  AOC)r  *21 ;W^‘A*Wr 


(13) 


Substituting  Equation  (1)  into  Equation  (9)  and  using  a£(r,t)  yields 

bi  -/  \et(z)-E0  sin(t O0X+fiJ  a^(u,t)du-f-(pj\  (z)dx. 

Using  Equation  (11)  this  becomes 

6;  -J~  ]ef  (X)  -  EQ  sin  (co0X  ^  22^ _  /  0m(u)dur  £)]  ft* fa; dt  (U») 

— =  -£‘0/?/ cos  (co0%  + /3  f  22  AWm*-r/Z(t>m  (*)du+<p)[ \tA<pr(u)  da  pi(x)dx 
dAWr  «4.r  <4-r  n”<  Jt-r 

-~E0ftf  cos  (<jJ0z+fif  a*(u,t)<du  + <p)f  Ar  <Pr(u)  otuyi(%)  d%  (15) 

<4-r  °4-r  *4-r 


Substituting  Equation  (15)  into  (13) 


fi22.  '“•I  bl  [  cos  (u)0Z  +ft[  a*(u,t)du+<p)f  dz  V;(x)  dx 
<4-r  •'t-r  h-t  Ar 


(16) 


Multiplying  both  sides  of  Equation  (16)  by  A.r  <pr(r)  and  summing  with  respect 
to  r  yields 

nX  rX 


<2i 


\(r ,t)-22*  l2  [  cos(u>0z+J  a*K(u.,t)du+<p)f  <t>r(z)dzf£(z)dz 

r"  <s/  c-T  Jt-T  J*-T 


(17) 


Interchanging  both  summations  with  the  %  integration  and  the  r  summation 
with  the  z  integration  yields 
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a*(r,t)  -  E0fif  cos(u)0%+fif  aK(u.,t)du. +  <$>)( f  T'.  Mi bj  l/fj (xjjdx  (18) 

<4-r  0 t-T  t-T  r‘f  r 

We  mast  now  consider  what  happens  as  R — ►  a?  .  If  aK(u,t)  converges 
in  the  mean  to  some  function  a.*(u,t)  ,  then  it  is  easy  to  see  that 

ft  r<z*K(u,t)  du  converges  uniformly  in  x  to  J*  ^  a*(uu,t)  du-  for 
t  -T  <  X  4  t  .  Therefore,  the  first  expression  in  the  integrand  con¬ 
verges  uniformly.  The  second  expression  converges  uniformly  to  J  R(L{z,v)dz 
by  Mercer's  theorem.  For  the  third  expression,  define 

9kM  •£  Mi  t>;  ipi  (%)  (19 ) 

1*1 


Then,  it  is  clear  from  Equations  (?)  and  (9)  that 
,t  rt 


[  Rn  (s,  x)  <jK (x)  dz*f  fe,(x)-e2  [z, a']  *)  W (s)  dx 

U-t  J  i=< 


(20) 


Now  it  follows  from  the  fact  that  [ift]  is  80  orthonormal  complete  sequence 
that  the  right-hand  side  of  Equation  (20)  converges  in  the  mean  to  et(s) -e2\$,cf\ 
but  this  does  not  prove  that  {  9*]  converges  in  the  mean.  However,  it  can  be 
showf^that,  as  the  eigenvalues  Z;  become  large,  the  eigenfunctions  Tp; 
contain  terms  of  higher  and  higher  frequency.  Thus,  assuming  a  bandwidth 
limited  channel,  it  is  reasonable  to  assume  that  the  higher-order  bi  are 
so  small  that  Equation  (19)  converges  in  the  mean  to  a  function  g(z) .  We 
are  now  Justified  in  letting  K  go  to  °°  in  Equations  (18)  and  (20)  to 
get  the  following  integral  equations: 


pt  pX  pX 

a*(T,t)-E0/2  cos(u>0z+/3  a*Cu,t)c6u  +  <p)( j  R^(z,r) dx)  q(x)  dx 

J t-T  Jt-r  * t-T 

ef(z)  - Egsin (uj0z a*(u,t) du  +  <p)  *f  g(z)  Rn  (%,z)dz 
*t-T  ^ t-T 


(21) 


(22) 


The  pair  of  integral  equations  (21),  (22)  specify  the  operation  of  a  maxi¬ 
mum  likelihood  FM  receiver.  Note  'that  the  maximum  likelihood  estimate 
o.*(T,t)  is  determined  by  all  the  available  data  et (s) ,  t-T  4  s  4  t  . 
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2) 


Solution  of  the  Integral  Equations  for  the  High  Signal-to-Noise  Ratio  Case 


If  the  noise  is  white  Rn(s,x)~  (s-X) ,  Equation  (22)  has  the 


solution 


<s 'i(s)  -  e2  [s,a*]  g(s) 


where  6%  *  ^  noise  power  density  in  watts/ops  of  one-sided  spectrum, so  that 
Equation  (21)  becomes 

pt  pX  pX  X 

ct*(r,t)  *  j  cos(u>0 x  a!t(u,t)olu+<p)(  PA(z;c)dz)  elM-Eosin(uj0z+/sl a*(u.,t)du+ty\at%  (23) 
4-r  «4-r  t-r  Ji-r  J 

Equation  (23)  may  be  rewritten  as 

<x*(V,  t)  =  f cos(u>0%+fl(' a*(u,t)diu-<p)h(x,T)\jEosin(u)0z  a  (u)  du-  +  <j>)  f  n(x) 

€n  Jt.T  Jt-T  L  *4-r 

-  E0sin(ceJ0Xtfil  a.*(u,t)  du  +  rp)\  dx 

rx  Jt-r 

where  h(x,r)  =  j  Ra(z,T)  dz 

"t-T 

a*(V,  t)  -  [ h(z,T)  ( E0  sin (2to0%  +  fif  [a*(u,t) +  a.(u)]  du  +  2<f>) 

nJ*-T  L  TT  r* 

:.n(2cj0%r2fif  a.*(u,t)  +  2<p)J  +  E0sin/5  [a.(u) -a.*(u,t)]  di 
Jt.T  J  J t-r 


-  E0  sint 


+  2n(x)  cos(it>0%  + /if  a*(u,t)  du  +  (pj^dz 
r-r 


(2W 


The  contribution  of  the  term  in  {  )  may  be  neglected  for  u)0  sufficiently 
large.  Writing  n(x)  as  n(x)  *  nc(z)costo0z+ns(z)sin  u)„x,  where  nc(%)  and  ns(%) 
are  independent  white  gaussian  processes  each  of  intensity  2e*  ^we  get 


a*(r,t ) 


’■  — ^y-  h(x,T)  E0sin/3l  [a(u) -a*( u  ,tf]  du  +  nc(x)  cos^fi  j  a.*(u.,t)du  +  <p) 

U"Jt.T  jt-r  Jt-r 

-  ns(x)  sin(/5  a*(u,t)du.  +  <p)+[ ne(z)cos(2uJ0z+ fi  a*(u,t)du.-h  <p) 

J*'T  rz  j  J*'r 

+  ns  (z)  sin  (2co0z+/3J  a*(u,  t)du  +  ^)j J  dz 
Again  the  terms  in  {  }  may  be  neglected  for  sufficiently  large  u>0  so  that 


(25) 
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<&(%  t ) »  r^o  sir>A I  l&(u) - a*(u,t)]  da + 

n&(X)cos^J  &*(uii)du+<pj-ns(x) sin (fij o?(u,t)du  +  4>j  dx 

For  sufficiently  large  signal- to-noise  ratios  we  assume  that  a?(u,i)  — *■  oXu) 
in  such  a  manner  that  |  ft J  [a.(u)-a!r(u.,-t)]  da. J  «  1  .  This  permits  Equation 
(26)  to  be  written  in  the  linearized  form: 

ertr.*)  •  [ctfu)-cf(u,t)]du  +  r>c  cosf(x)  -  ns  sin  fix}  J  dx  0 

=  JS>  f  a(u.t) du.  + tf>  ■ 

h-r 


where  fix) 


Now  let  us  examine  the  term 

qix)  »  nc  cos  fix)  -  ns  sun  fix) 


Since  nc  and  ns  are  independent  gaussian  processes,  rj(x)  is  also  a  gaussian 
process.  A  gaussian  process  is  completely  determined  by  specification  of  its 
autocorrelation  function 


<(q(x)q(z+ r)>  ■  </{nc  (x)  cos  fix)  -ns(x)  sin  f(x)}[ncix*-T)  cos  f  (x+  X)  -ns  (x+  z)  sin  P(x+r)}y 


~<\nc  M  nc  (x  *■  z)}  cos  f  ix)  cos  f( x  +  z) 
+  t13(x)  nsix+Z)}  sen  f(x)  sin  f(z+r) 

-  <^nc  ix)  ns  ix+  z) y  cos  f( z)  un  f(x+X) 

-  </,ns(x)  ncix+r)y  stn  fix)  cos  f{x  +  X) 


M  2enZS(o)[cosf(x)  cos  f(x+z)  *■  sin  fix)  sin  f(x+t)] 
*  2e*6(o) 


so  that  q(x)  is  just  white  gaussian  noise  of  intensity  Ztn* 
The  integral  equation  to  be  solved  can  now  be  written 


*■**■  r*  rx  r* 

— j — J  dx/  dul  dv 
fn  J(.r  Jt.r  Jj.r 


dv  #Ju,T)[a(v)- a*(vj)]b 


du#a(u,Z  )>,(%)  (28) 
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Let 


£(r,t) 


loJL 

2e* 


r* 

dx 


du.  Pa(u,r)  r/(%) 


't-r 


' t-T 


(29) 


b(u,t)  =  a(u,t)  -  £(u,t) 
t?(u,  t)  =  <z*(u.,t)  -  £(a,t) 


(30) 


then 


,  Eoft 


6  (r,  t)  = 


~~i ~  / dx  j du  ft dv  Pa(u,T)  \_b(v,t)  -  £(v,  tj\ 
€n  t-T  t-T  t-T 


In  order  to  obtain  an  explicit  solution  we  assume  that 


Ra(*,r)  =  j  4eJ  e~’*lu~Tl 


(31) 


(32) 


el  d2 


which  corresponds  to  the  power  spectrum  Sa(<*>)  =  • 

Note  that  the  mean  square  value  Pa  (power)  of  the  intelligence  a(T)  ie  given 
by  Pa  -  Ra(o,o )*  »  we  shaH  eventually  normalize  both  the  distortion 

and  the  noise  in  the  output  to  this  factor.  (The  reader  who  is  not  particularly 
interested  in  the  details  of  the  analysis  may  at  this  point  prefer  to  go 
directly  to  Equation  (1£). 

Substituting  Equation  (32)  and  interchanging  the  order  of  integration 
we  get  _  , 

4E2/326?  r  r  f  +*(u-r) 


t>  (r,  t  )  = 


^n2 


\t>  (v,t)-  b*(  V,  t)\ 


.  *e02AI  f* 


/  da  /  dx  /  dv  e 
t-T.  Ju.  Jt-T 

r*  -4(u-r) 

dx  d/  e  \b(v,t)  -  b  (v'.t)] 

r  *4t  J,.r 


(33) 


Differentiate  twice  with  respect  to  Xf 

db*(V,t) 

dr 


(3U) 
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Hr*i}  “  job  jet*  l&fat)-  b*(v,  tj] 

\  2  2  2  2  P^  /'^' 

“  [t>M-b%,t)2  -  -ffj*  / dxj  dv  \b(v,t)-b*(v,t)~\ 


+  dJdx  dv  e 

/  /  / 
ur  jol  Jt-T 


(35) 


and  we  see  that 

9  b(r,t)  .  ,V  .  .zhiSf^tdn  A  [b(v,0- b%,t)\ 

n  or  Jt-r 

(36) 

d3b'(r,t)  .2  db*(r,t)  E2nfi2eUz  fr.  r. ,  ,,  ,n 

dr3  *  dr  *  2  "  Ve  2  /  \_b(v,t)-b(v,t) \ 

n  Jt_r 

(37) 

d*b'(r,t)  t2d2b*(r,t)  _  ,  E2fiVa42  r, .a 

dr*  4  dr>  2  ¥e*i  \p(r,t)-b(r,t)\ 

(38) 

To  get  boundary  conditions  which  specify  a  unique  solution  of  Equation  (38), 
we  get  from  Equations  (33)  and  (3li) 

- b*(\ v,  tj\ 


a  l?  /  ^ r ^  ^  P  ^  P^  P  ^  ■£ Ptj  -  +  ) 

"  (t,  t)  - - °^2  €°'  du dz  j  dv  e  \b(v,t)  -  b*(v,  tj\ 

n  Jt-r  <4  Jt-r 


So  -  4  b*(t-T,t) * 0; 


* 

~r  (t,t)  +  4  b*(t,t)  -  0 


(39) 

m 

(Ul) 

( h2 ) 

0*3) 


Also,  from  Equations  (36)  and  (37), 

.  0-4 2  £(  t,  t)  -  0 


m 
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The  system  of  Equations  (38),  (1*3)  and  (iiii)  can  be  solved  by  means  of  a 
Green's  function  G(Tr,^,  t)  ,  that  is,  we  can  set 


b*(r,  t) 


-  f  G(r,$t 

Jt-T 


t)  b(£,t)d£ 


Let  us  introduce  the  notation: 

■cJfiUl  -  <A 


u  _  SEe‘/3  €a  ) 

A  \-n7TF~) 


Lr  "  dr* 


[dimensionless  parameter^ 


dtA 


Atf(r)  =  —  (t-T)-  4f(t-T) 

A2 Hr)  =  ~  (t-T)  -  4Z (t-T) 


dr 


B,f(r)  =  ~  (t)  +  4f(t) 
Bz  Ur)  =—(*)-  &Zf(t) 


(1*5) 

(1*6) 

(U7) 

(1*8) 

(1*9) 

(50) 

(51) 


where  f(v)  is  an  arbitrary,  continous  function  of  T  .  Then  G  must  satisfy 
the  following: 

Lr  G(r,£;  t)  =  (52) 

/4m  G(r,  t)  =  0  -  Bm  G(r,  fr;  t)  (53) 

Equation  (52)  means  that  LTG  •  0  where  ,  and  at  r  »  £  ,  d  3&  (t,  g;  t)/dr2 

has  an  upward  jump  of  . 


To  solve  Equations  (52)  and  (53)  we  shall  use  matrix  notation.  First, 
define  C  to  be  the  complex  number  such  that 


c  =  4 


f  TT~T  .  lit  / 

*  'hX"H 


(51*) 


so  that  C-  4  cz  +  X  4 


The  elementary  solutions  of  the  equation 
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LrG  * Oan  arranged  in  a  row  matrix t 

.  f  C(r-t)  c*(r-t)  -c(r-t)  -C*(r-t)  1 

u(r;t)-  y e  ,  e  ,  e  ,  e  J 

and  we  express  G(v,£-,t)  by  means  of  two  column  matrices  j}(£;  t)  and 
$.(£’>  *)  * 

" u(r;t)  £(%;t)  ,  t-T4^4T4t 
G(r,t;t)  »  ~ 

.  u  (r;  t)  t)  ,  t-T4r4%4t 

Now  we  define  the  square  matrix 


u  (£;t) 
u.'  ( f;  t) 

“'(M 


(55) 


(56) 


(57) 


where  primes  denote  derivatives  with  respect  to  T  j  this  is  the  Wronskian 
matrix  and,  hence,  is  nonsingular.  Similarly,  define 


0 

X 

*i  a 

B  * 

0 

0 

B ,  L l 

0 

Bz  u 

(58) 


Now  Equation  (52)  is  solved  for  ?"=£■  £  by  virtue  of  Equation  (56) j  for  Vm  £  , 
the  continuity  conditions  can  be  expressed  as 


%(£i  £’>  ~  f  (£i  t)) =  ^  fW 


The  boundary  conditions  can  be  expressed  as 

A$(£,t)-o,  £/>(£>*)' 0 

With  a  little  manipulation  we  find  the  solution 


(59) 


(60) 
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(61) 


Now 


A  « 


^  -  4  A  (A+Br*AH'*& 

£  -  A**' (£+§)'*  BW''& 


ec(4-t) 

Cec^'t) 

ere**'* 

c‘ec<*-,> 

c^-tJ 

C,ec(t'i> 

*3  c’(A-t) 

C  e  y 

(c-i)e-‘T 

(C*-A)eC'T 

(c’-t3c)e'Cr 

» 

1  Vi 

■ 

'i* 

0 

0 

0 

0 

e-c'(S-t) 

-cecf(-t! 

-C’e^-V 

i i-c*Q-t) 

-C-3ec'(*-t} 

■(cU)cr 

-(C%A)ec*r 

,3  CT 

~(C -A  CJe 

-(C*3-42c)e 

0  0 

0  o 


(62) 


(63) 


B  = 


0 

0 

(c+A) 


0 

0 

C*+  A 


o  o 

0  0 

-(C-A)  -(C*-4) 


(6U) 


L^-*a  c#2-«*2  c2-^2 

Now  if  the  real  part  of  CT  ,  that  is,  AT ,  is  sufficiently  large, 
the  entries  in  the  first  two  columns  of  A  approach  zero.  Thus,  using 
Afgj  ,  B(,)  ,  and  B(2)  to  denote  appropriate  submatrices, 


'  0 

Ate) 

_  0 

0 

o 

o 

i _ 

,  A  +  6  - 

i 

O 

o 

a 

_ i 

! — 

r - 

-§.(iy§ay 

May  Q(z) . 

(65) 


(A  +#)-'= 


~§(d  §(2)6(2/ ;  8m ' 

0  -8(0  6a) 

1  6  a)1 6  a) 

t  _ 
■ 

- - - | - 

.(a+bY'a-- 

, (6*8)  '§  = 

6(2)  I  0  . 

Of 

0  0 

j 

(66) 


A  more  detailed  analysis  shows  that  Equation  (66)  is  correct  to  within  . 
an  error  of  order  | Z  ZCT\  „  in  effect,  then,  we  have  let  T  tend  to,  oo 
We  now  find 
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- 1 


^  " <cc*(c~- c'*) 


-ar-V"™  -cYmtl  +ccYclM)  + 


***«^-" 


-rcV*™ 


Ce 


-cc^'cW'"  +c‘¥v-'>  *rc‘€fC‘*-t>  -&«*'*> 
fcWdc-'  -cV1*-11  -ccY^  +C'C'l!-‘> 


(67) 


&(t)  ~ 


■  1  1 

~C+-k  o' 

R,f)'=  1 

'C*+t  0 

'•(CH)  i' 

C-£  c*--k. 

0  c*+i 

(c-c*)(c+m*+i) 

0  c+i 

.c-t 

(68) 


§(i)  &(2.y 


~(C+C*)  (C*+  i  )(C- i)  ZC *(C  v  i)(c  *-  i) 
(c-c*)(c+-k.)(c*+t)  L -ZC(C+i)(C-il)  -  (C+C*)(C+A)(C-t) 


cc* 


t  X  %  e¥  =  C  C  W  e¥  - ^ (qK  c*z) 


r  c*z’G(*-*} 

-Ce 

-C*e 

Ce *'<*’*> 


(69) 


(70) 


(*^)  'As(c-c*xc+i)(c*+  i) 


0  0  -(C+C*)(C*±i.)(C-l)  -ZC*(C*+H)(C*-t) 


0  0  ZC(C+H)(C-L) 

0  0  (C-C*)(C+t)(C*+k) 

0  0  0 


(c+c*)(c+mc*-k) 

0 

(C-C*)(C+i.)(C*+t) 


(A+fy  ~m  (c-c*)(c+rn**i) 


(71) 


-(C-C*)(C+H)(CM)  0  -(C+C*)(C*+t)(C-A)  -ZCf(C*+-k)(C*-D 

0  -(C-C*XC*t)(C*-i)  2C(C+%)(C-k)  (C+C*)(C*-k)(C*-D 

ooo  0 


0 


0 


(72) 


Solving  for  G(r,  £  ;i)  one  obtains 
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cc* 


i}  =2(CZ-C*Z)(C-C*)(C+l)(C*+i) 


+c(c+c *)(C+Jl)(C - 2 CC *(c *+l)(C-i)e ~(o+C*)t+CnZ+Cv 


(73) 


-zcc*(c+ii)(c-7i)e  -<C+C*)i+Cf+C*T -c*(C‘C*)(C+MC*+t)e~clv'fl 
+  c(c  -c*)(c+JL)(c*+A)e  c*lT'*  ;J 

To  recapitulate,  f 

b*(rht)*  I  G(r,t;i)b(hi)dt 


or 


a*(v; i)  =  c(r;  t)  +  f  G(r, lit)  \a($)  -  C(lj  t )]  d£ 

*/_  /M 


(U5) 

(7W 


with  £  given  by  Equation  (29)  and  6-  by  (73). 


Now  i-r  may  be  considered  as  the  "delay  time"  of  the  demodulator 
which  these  equations  describe.  In  particular,  we  shall  consider  the  cases 
of  zero  delay  and  infinite  delays 


Zero  delays  t  *  Z 


Infinite  delays  i 


G(v,t;Z)  =  G0(t-$) 


CZC *Z 


-c(e-f)i  -C*(r~{) 


(C-C*)(C+l)(C* 

°°  ■  G(t,  oo)  =  Gj r-l) 


+  e 


CC' 


2(Cl~  Cl) 


-CYclt-sl  <-Cc-c‘II'sl 


(75) 


(76) 


It  will  prove  useful  to  note  from  Equation  (5it)  that 

cz+c*1  --  a’- 


(77a) 


19 


RADC-TDR-63-147 


Alternatively, 


(C+£)(C-£)=  -  C*Z 
(C*+  i.)(C*-Ji)  -  -Cz 


also 

££  *  =  &*\z 

so  that 


Gjv-Z)~ 


(C-C*) 


-c(r-t) 


+  z 


-c*(v-  () 


(77b) 

(77c) 

(77d) 

(78) 


z(cz-c*z)  L 


C(Cz-&z)e 


■cfr-fl 


-  c*(c*  -  £  )e 


Z\-C*lr-f  | 


(79) 
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3)  Derivation  of  the  Mean  Square  Error  and  Its  Sensitivity  to  Off- Design 
Conditions 

It  is  of  interest  to  evaluate  the  mean  square  difference  between  the 
function  afti.-t)  obtained  as  the  solution  of  Equation  (23)  by  the  methods 
discussed  above,  and  the  modulating  function  Q.(t)  ,  We  note  that  Equation 
(23)  was  derived  on  the  assumption  that  the  difference  between  the  received 
and  transmitted  signal  consists  only  of  additive  noise  of  known  intensity. 

It  seems  unrealistic  to  assume  that  the  strength  and  the  phase  of  the 
received  carrier  or  the  intensity  of  the  additive  noise  are  known  precisely. 
We  shall,  therefore,  determine  the  dependence  of  the  mean  square  error  on 
variations  of  these  parameters.  Two  observations  can  be  made  at  this 
point;  (1)  the  function  was  obtained  as  the  maximum  likelihood  solu¬ 

tion  on  the  assumption  that  these  parameters  are  known  exactly,  (2)  the 

maximum  likelihood  solution  is  not,  in  general,  the  least  mean  square 

,  C 63 

solution  . 


We  will  now  investigate  the  mean  square  error  of  a  detection  system 
which  operates  in  accordance  with  Equation  (  23)  derived  on  the  assumption 
that  E0  >  4>  and  en  are  known  exactly  but  instead  receives  E0 ,  <j>  * 

A 

and  €n  .  The  determination  of  the  sensitivity  to  deviations  from  design 
parameters  is  particularly  important  in  cases  such  as  this  where  the  system 
has  been  optimized  in  a  fairly  abstract  manner,  for  example,  variations  of 
the  phase  can  be  disastrous  to  a  coherent  PSK  system. 


Let 


A 


'V-; 


e,(r)  =  E0  sin  (%v +/3 j  co(u)du.+4  +  n(t) 


A 

where  E0  =  /cs  t0 .  strength  of  received  carrier 

ri't)  =jxr,  n  (t) .  receiver  noise  of  intensity  6* 

The  three  parameters,  fj...  ,  jun  ,  A<f>  are  introduced  here  to  account  for. 

"off-design”  operation. 


(80) 
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Substituting  Equation  (80)  into  (23) 


a*(x,i)  =  cos(uJ0x>  +  &\  a,*(uj)du,+4)(!  Ra(z,r)dz) 

T  n  Jt'T  X  "-T  X  1 

/Aj  E0  a (ti)du+<j>+A  4>)+//nn(z)  -E0  sin(u)0x+ ^  a?(o*,i)du.+ <f>jdx, 


We  will  first  assume  that  A  j>  *  0  and  later  consider  the  case  ^  0 
separately.  By  repeating  the  arguments  which  led  from  Equation  (23)  to 
Equation  (28)  one  obtains 

a*(rj)  ~  /  dxl  dz\  duRai(z,z)\au(u.)-cb*(u)\ 

Z£r>  Jt_r  J-t-T  h-r  L  J 

+  f  dxf  dz  Ra,U,  ?)  n  U) 

/Cen  Jt-T  J+-T 

where  q(x)  has  the  same  statistics  as  before:  white  gaussian  noise  with 
autocorrelation  function  Z6nZ8(t)  .  The  solution  of  Equation  (82)  is 
given  by  Equations  (7li)  and  (73),  with  these  changes:  A  is  redefined  as 


^  &  x  *-  *1 


Rs  Ep  A  £<i 

Z-kzCn 


C  -  \  d.xf  dzRa,(z,z)  r/(x) 

Ji-r  J 4-T 


From  Equation  (7li)  we  see  that  the  solution  of  Equation  (82)  can  be  symbolized: 
a,*  -  *  <j<z  -h  (i - %) C 


The  difference  <x-cx* can  then  be  written  as 


a.- of  =  (i-g)  a  -U-f)C 
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While  both  terms  are  stochastic,  they  are  independent  since  the  first,  or 
distortion  terra,  is  a  function  of  the  signal  cu(t)  only  while  the  second, 
or  noise  tern,  is  a  function  of  the  noise  n(x)  only.  The  mean  square  error 
is,  therefore,  given  by  the  suras  of  the  mean  squares  of  the  separate  parts 
which  we  will  now  compute  for  the  case  of  zero  and  infinite  delay. 


a)  Zero  Delay 


(l)  Distortion  term,  D0. 


/ 


(86) 


<x(t)  nay  be  obtained  by  passing  white  gaussian  noise  a(t)  having  intensity 

a* 

£  2  through  a  filter  with  transfer  function  I  F(ou)lz  =  jrj— — so  that 

**  K  -r~  CO 

a(4)*~k[  e  *Ta(i-  z)  ciT  (87) 

*0 

00  00  0O 

J  dLzAG0(Z)z  a(l-?-r)  -J dzit^\(i-r) 

•f  dr[J^ctfG0(Z)ie'i(r'()-te'*r]<z(4'r).  (88) 


.  -Aiz-f)  rT*(C-t)(C*-&)\  -(c-i)Z-*t  -(C*A)i-Az 

j*  d£G0(f)e  =J'  Tt~*  i-e  +e 


C-C* 


dt 


A  r-  (C*-  *)e’*r+(C  - t)z~CT+  (C- 1) e  '* r-  (C-  A) e ‘c'r 


C-C 


.  -4r  t(C*-i)  -cr  t(C-A)  -c*T 

=  *e 

Qj(t) g'cr-  jfr&r  g 'c*rj oc(t-r) 


(89) 

(90) 
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The  mean  square  of  the  distortion  term, 


-k(C*-i)  -ct  H(C-A)  -c*i 


D0*<(9*(U)-a(Op=6lfo 

-e°iM 


c-c' 


e 


1' 


r 


-zcr  Ztz(C-t)(C*-i)  -(c+c*)T  -zc*r 

(C-C*)z  2  ~  (C-C*)2  ( C-C*)2 6 

z 


'*  (C-C*)2 1  2C 


(C  *-  if  Z(C-  i.)  (C*-i)  +  (C-i) 


C+C' 


(C-C*)z 

=  AV 

(C-C*)z 


ZC * 

c*-% 


c-a 

ZC * 


'  ( C+C*)(C*-i)-2C(C-i )  f  ,.(C*-i)2C*-(C+-cyc-t) 

(c  ZC(C+C*)  "(l  %)  ?r*cr+r*\ 


*  <c-u 


r"'- 

(c-c*) 

(C-C*) 


ZCCC+C*) 

~(C*-i)(-2C-C*+i)  ,  (C-H)(C+2C*'tj 
2C(C+C*)  ZC*(C+C*) 


ZC*(C+C*) 

Cz+CC*-2C*l-&C+HC>* ) 
2C*(C+C*) 


-  Z  (C  +  C*)(C*-£)  +  (C***)(C*-j)  2(c+c*)(c-i)-(c-i)(c+i) 

ZC(C+C*)  ZC*(C+C*) 


2C*(C+C”) 


-  f  £- 

(c-c*)  L  c 


(C-i) 

+■  — —  +■ 


2C(C+C*)  c*  2C*(C+C*) 


_  i*€ef[ -C*(C*-£)  +  C(C-£)  _  C-c * 


C-C*[  CC* 


2(C+C*) 


jt,  z\C+C*-i  1  I 
ij  x  *1  CC*  2(C+C*)\ 


*V 


Z(C+C*)l-Z*(C+C*)-CC*  _  jt*€j  \3CC *-Zt(C+C*) *  Zi*]  m 


ZCC*  (C+C*) 


ZCC*  (C+C*) 


From  Equation  (5U) 

cc*-Hz\z,  c+c*  •tfiFTT. 


so  that 


n  5^-hZ-Z^Z^-hf 

u°  z  a  Mzy+r' 


3AZ+  Z-ZJvF+1 

JfWTT  * 


wx'p* 


for  large  A* 


(91) 
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The  mean  square  distortion,  D0  ,  is  determined  by  the  product  of  the 
intelligence  power  Pa,-jA^  and  the  function  f(\)  »  --  ^  ^  • 

It  will  be  noted  that  f(X)  decreases  monotonically  to  zero  with  increasing 


The  value  of  the  dimensionless  parameter  A  ) 

provides  a  quantitative  measure  of  the  channel  quality*  It  seems  worthwhile 
to  explore  the  relationship  of  A  to  the  more  conventional  FM  parameters 
of  carrier-to-noise  power  ratio  and  modulation  index.  In  the  usual  FM  analysis 
sinusoidal  modulation  ab  frequency  fa  is  assumed.  The  discriminator  out¬ 
put  is  passed  through  an  ideal,  rectangular,  low-pass  filter  and  the  noise 
power  is  computed  in  that  bandwidth.  The  modulation  index,  M  ,  is  defined 
as  the  ratio  of  carrier  frequency  deviation,  Af  ,  to  modulating  frequency 
.  In  order  to  apply  these  concepts  to  the  situation  at  hand,  wre 
define  a  noise  equivalent  bandwidth  Bn  and  the  modulation  ihdex  Mas  follows: 
Let  Bn  be  the  bandwidth  of  an  ideaL,  rectangular,  low-pass  filter,  having 
the  same  area  as  the  intelligence  power  spectrum  . 


B 


00  4*  ,  A 

a  Z  t  *2  cCC4J  -  OPS 

-k*+(»z  z  r 


(double-sided  spectrum) 


The  noise  power  N  in  the  bandwidth  is  then 

/V  =  €nz  ■  j  A  . RF  noise  in  intelligence  bandwidth 

The  modulation  index  M  is  defined  by 

tJZ  _  Mean  Square  frequency  deviation  due  to  modulation  ((Af)Z} 

“  - -  _*>  —  - — i>  -  n  X 

Bn 


Square  of  noise  equivalent  bandwidth 
\2>  a  ■*  l 


\ZwBj  '  <2rr)z3n  ' 


The  intelligence  signal  &(?)  can  be  obtained  by  passing  white  gaussian  noise, 
of  intensity  ,  through  a  filter  with  transfer  function  \F(u>)  j1*  'C"/(w%+  i.1), 
the  intelligence  power  is  then  P**  %(*€&)  •  An  ideal  filter  of  bandwidth 
Bfj  will  also  have  output  power  P&  $  hence,  3^  is  called  the  noise 
equivalent  bandwidth. 
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Then 


(92) 


t  =  Z 


where  Pr  -  -z  E, 


Design  Carrier  Power 


(2)  Noise  tern,  NQ  . 

In  order  to  obtain  the  steady-state  noise  term  of  the  aero  delay 
estimate  we  let  T-~ 00  in  Equation  (8U)  • 

f  X 

s(x.-t)  *  f  dx  f  otz  Ra,(z,  z)  r/(x.) 

^  -  00  00 

*?£*.**  rcuj^dze'^^^x) 

~n  J-00  -  00 


/*/> t-a.i1  rt ,  rx ,  -Ah-zi  , , 

'  /  dxJ  dlt  V*> 


(93) 


A  OO 

dSG0(S)K(t-h*) 

■  0 


(95) 


*/*-*/ 


Note  ***** 


(96) 
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Since  /j(»)  is  stationary,  it  is  clear  that  the  statistics  of  the  noise  term 
are  independent  of  t  ,  and  we  will  therefore  let  t  -  0  . 


f  cL{Gt Me'*1*'*1  d<fG0(i)e'A(i*i) 


(z  <o) 


r,  (C-*)(C:-*)f  ^  _e-(C-A)i+U  +  e-(c*-A)i+l» 
Jo 


C-C 1 

(C-t)(C*-A) 
C-C*  J. 


g- (C*+M)£ -i,e 


= q7c^(c  *-U  *Ai+ (c*-  *)e  c*+(C-ih  u-  (c-t)ec**  j  (97) 

'  'C'*)(C*~4-[-(C+A)-1eCi+(C*<t)-'ec** 


C-C' 


Ae  Zi(C*-i)  Ct  Zl(C-A)  c#, 
~e  *(C+t)(C-C*)  ~(C-C*)(C*+-k) z 


[dz  J  d?G0(t t)e~AI**(l  -e*! 


vr  we*-**  ec*  zt(c-t)  c*z i 

l  (C+t)(C-C*)  ( C-C*)(C*+t )  J 


2A(C*-A)  cx  ZA(C-A)  „c* 
C(C+*)(C-C*)  ~  C*(C*+A)(C-C*)  * 


(98) 


Substituting  Equation  (98)  into  (95)  and  recalling  <.y(x)  rj(xrr))  ~  Zc*&(t), 
one  obtains 


a s  <($<;( t,t)  -  c(t,t))z> 
Mnl €***'''  *° 


rfcg.2*.**?  r°.  \  Zt(C* 
lol  \.C(C+k, 


- t)eCx  zA(C-*)ec '* 


C(C+A)(C-C*)  C*(C*+t)(C-C*)\ 


(99) 
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/v„  - 


Mn^gA  A 


\n*(C*-i)¥C\  8iz(C-k)(C*-t)c CH*'  uhc-ife1^  ' 

LdK  L c*(ch)1(c-c*)z  ~m+m*+m-nl  Vt^rt-n2 


rc-cy 

_ 6  Al(C-A)CC*-i)  U*(C-A)* 

c3(c+u\c-c*)z  ’ CC*(C+C%C-t*)Z(C+m*+1L)  c*\c*+tf(c-c*? 


M>iclC*1 

’  ZAZ(C*-lf 

fys 

C3(C+tf(C-C*)z 

z  z 
P'n  &  a 

~ 2A?(C-&f(C*-if 

CC2(C-C*)1 

-*\  z 


Z(C-A)*(C*-A)Z 

kr*(r-r*\z 


z  1.2 

Pn  £< 

2/zsC 


C‘C*(C-C*) 

a  A  (C-t)  (C*~  A)  f  ,iCC*'t-C*(C.+C*‘) 

^‘‘(c+c'xc-cn™' tc  >  wc  c  (c*c  { 


l/is C‘C-‘(C+C‘)  ? U.SC*C‘*(C*C*)\.CC  ~*(c*c  >ri  _ 


isCzC**(C-hC*)  Z/zs  c‘c*z(c 

=  ^  ^c4^C+C*)[CZC*Z~£A  CC *(C+C*) * Z Z(C+C*f- ztfc+c*)^ 

~  Z^!cl"c**(tc*)  \fC  *  *~ZA  CC*(C+C*>+  ^CC  *-2**(M*)  +  z*¥\ 

z  /*nz  X*+  ¥-)?+Z  -  (IA1+  2)-{2Az+-1 

=  *  €a  '  *  x*7z7?7 

Mn  n  \*+*XZ+Z  -U\ l+Z)htf+t 
'  /*,  *  Avy  ix*+/ 


(100) 


For  large  A  ,  this  is  approximately 

z 

M't 
*o 


Nn  -  Pn 


1 


/*  *  yn  • 


(101) 


The  mean  square  noise  term,  A/0  ,  is^ obtained  as  the  product  of  the  intelligence 
power  P&  -  Ae£/2  and  the  term  g(X)  where 

vf+z -(zxl+z)  t/2  XZ+ 1 
?ft) - WzM  - 

again  decreases  monotonically  to  zero  with  increasing  A  . 
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The  total  mean  square  error  h/c  is  obtained  by  addition  of  the  distortion 
term  Equation  (91)  and  the  noise  term  Equation  (100). 

[3&2-2t/z£+1  .  /Xn  \*+WZ+Z-(l\l-n)-lz\l+1  1 
A7  Z\z±1  /zs  \y2XlH 


H0-((a.-**)Z>z„0=Pa 

oeiM 


(102) 


b)  Infinite  Delay 

(1)  Distortion  term,  Doa  • 

oo)  =  f  Gj$)CL(t-?)dZ 

-  OO 

att)  =  a[  oLre'ira(t-r)dz 

Jo 

oo  oo 

QojCi.oo)  =  a  d?  /  drGcWe'^ocd-t-z) 

J-  OO  Jo 


Let 


X 


r~  x-f 


then  x  runs  from  -  oo  to  oo  ;  %  runs  from  -oo  io  X , 


-o°  ~  * 


Qa,(t,oo)  *  a[  dxf  dZGaa(%)e  ^^^ccd-x) 

"  V-ea  J-OO 


(103) 


(10U) 


(io5) 


^<x(i,oo)-<xU)  = £  dx^nf*ct{Goo(?)e' 


Ax+At 


cc(t-x) 


+f  dtGec(£)e*x**'*-  £e  **~j cz(i - x ) 


(106) 


Now  for  x<0  ,  we  find  from  Equations  (76)  and  (77) 
'*  Ai-Az  A  /'t 


d?GM) 

V  -  oo 


0 


2(CX-C**) 


c7c*-i)ec*x]  (107) 
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(108) 

*  [«*«**•'“;  -***><'-*-•-*)] 

r*&*C*i)L-4*  t[CM-C'*+LC-AC*]  _-*z  *c(c+t)e<\  AC*(C*+A)e~C* 
s  [z(c7c*)  1  +  Z(C*-C+*)  '  Z(C*-C»*)  2(Cd-C"*) 


*  -Ax  dC(C+d)  -c*  ,  7iC*(C*tji )  _-c*x 
~  Z(C*-C**)e  2(C*-C*z)e 


From  Equations  (87),  (106),  (107)  and  (108) 

C^*((q.a,(t,oa)-CL(-t))1L)  *  cU^kj'  ed 4  Gm>  ($)z 

j*  ftos) 

-  till  \c(C-*.)t°*-  C’<C-  *)ec’j  dx 

*  e* l \(cf:c.ijz [c(C+ t) eCK- C*(C*+i) ec>] *dx 

+ c*(c+i)  e  mXe*-2CC*(C+*X<?**)  z(C**)x+C*x(C*+  ife ' ^**] 

-  ^  y°  "l&*(c*+i  z)  e  ~ZCx-2cc'(zcc*+2%z)e(C*')x+2c*Yc*W 

-  t(c£?*)l[C(C*+  *XJ -  ZCC^*^-  hC*(C**+AA)] 


z  z 


'  ¥(CZ-C*i)t 


[S'c'-gg'rtc.d-gg--] 


1  •*/•/•* 
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■  V(C2-C*Z)Z 

a_**  4 
*V(CZ 


'c\c‘c‘  -¥c‘c’‘+cc‘> +C4  +,1tc+r>)i-Hf.r.*X\ 
c*c*  * — ^c1 - j 


:ia< _ uc-cr«r*3cc‘+c“)  t*(c-c’) 

+-+c* 

g£i[c'+scc'+c*+S] 


(V 

*(c+c 

jjzeZ(3CC*-hZAz) 

¥(C+C*)* 


or 


D~  = 


<?  *e*  'IWhI** 


«/2 


3A*+2 

*  2(zxz+  /;w 


+t[z 


for  large  A 


By  comparison  with  Equation  (91)  we  note  that  for  large  A  , 


D~  =r,P0 


/ 

V 


(no) 


(2)  Noise  term.  A/*,  . 


In  order  to  compute  the  infinite  delay  noise  term  M* ,  we  replace  the 
upper  limit  in  Equation  (93)  by  tQ  where  t0  will  tend  to  oc  „ 


A  OO 

9  ^  ’<,u) 


-ik-rl  , 
e  r/(x) 


(ill) 


(112) 
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.Jf.;  a«) 

Let  £-t*i'  .  For  z'<  0 , 

f  “cliGjtie*11'**1*  jy?^  (?)e*(***'+jf  d^GJO^*y)^d(Gjf)eA(^ 

•Jjtxch*) 


+jf  \f^t'ji^e'(CA)!*i,'c^ct'^ e'0*'^**1*  J 

~Z(C*-C**)  [cfc-*)e*K  C*(C*-t)e**+  c(c+A)(e**'-ec*' ) 

-  c  *(C  *+t)  (e**- e  c** ')  +  C(C-A)  eCi-c*(c-t)e  C**'J 
= z(ci:c»*)  [(ZC *- ZC*z)e **- 24 Ce Ce+24 C*eC** '] 


(111) 


_ii'-4UCi+tc*ec*1' 
~e  +  cz-c*‘ 


We  avoid  the  need  for  a  separate  computation  for  the  case  Z’>0  by  noting 

Ftt)  =  £  *~oCZ  G„(-Z)e‘*hy~(l 

*{  *  cLz  Gjx)e  ~*hl'tx  1  -  F(-i') 


so  that 


f  cttGUVe’*1'*'**1 


(H5) 


-tCe'01’'1  +  *c*e'c*u'1 

=  «  + - C*7cFi - 


32 


RADC-TDR-63-147 


Therefore, 


(116) 


c*-c*2 


(K'=X-t) 


For  this  is 


r%> 

L ** 


•ACe^'-hAC**0**' 


-Ae  Cx'+Jtec**' 


z . 


C2-c** 

The  integrand  in  Equation  (116)  is  an  even  function  of  z'  j  and  the 
integral  is  zero  for  k' —  0  ;  therefore,  the  integral  is  an  odd  function  of 
r 

-cl* 7. 


(117) 


f*',  ,f-ACc~  *  +AC*c 

IS*  [ 


a „  ~Clx'l  4'C*lxl 

/  >)  £g  ~*e 
'sgn(*)  cz  z 


(118) 


Therefore,  letting 


t0-t  -  , 

<V  /**/  .  ,i 


<2ir.  r^.oo)  -r. r«f)  =  ^  V*  /* ' c**'  w*7('A«‘c,*,-)ie'c*'*/0 

*  0  *°  ‘n'fiMs  J-00  L  c*-c** 


yoo  (119) 


and  hence, 


(120) 


Letting  i  -*•  00  ,  we  obtain 
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,‘CUrt  -cWLt 
dx'(e  -*  ) 

¥p,m  J-oo 


*/*$ 

/  at#  (e 

a/us  (c  -c*  )  J0 

-mZ&Vc*1  \l-i- 

2/us(Cl-C**)*  \_2C  C+C 


(C*-C**f 


ZCk 


ze 


-.tc+c*)x 


-2C*t  i 


1 

*  zcl 


'U'il±*,CC -  \c*(c+c*)-  4CC*+C(C+C*) 

,s(c+c*f(c-c*f  L  J 


. /VuVgg* 


(121) 


t*n 


ty.y(C+C*f  2  *  /zs  2(2)?+ if*  * M$  2(2)*+lfZ 


~  p  2*“n 

•  n 


a4  +&* 


for  large  A. 


By  comparison  with  Equation  (101)  we  note  that  for  large  Aj  /!£,  *  £ 


The  results  are  summarized  below. 

By  defining  the  dimensionless  parameter  our  results  can 

be  put  into  a  somewhat  simpler  form  for  tabulation  and  comparison.  Our  results 
are  summarized  as  follows: 


’o  Delay 


n  3^+2-  2^2)? +  1 

4 


_ P  -IzzLp 

aVS^T 


_  '  (7+1)7  “ 

V  -  zi  ^ rf+  z -u£ji  JI7T,  „  _  / 7 - 1  \*  i 

6  /i,  Xy 727+7  ^  *  X\  7+ '/  / 

Jj  =  njmAt  .  37Z+2Y-t+%tU'l)2 

H0  %+Nc  - ™ -  Pa. 

(r+i)  7 

r  i^S.  -  1  //a  ■— ^ p 


Pop 


(122) 

(123) 

(12U) 
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Infinite  Delay 

^  Z(vh  lfL  ~ 

(125) 

N  =  ^  „p  .  £a.  r‘~i  p 

~  ^  0V‘  *  A  ^  ‘ 

(126) 

u  =  n  ,  *r‘+l*£<rl./)l> 

Hoc  oo  yy3  •* 

(127) 

j  i_]  _  _J_  n 

For  ^  7  ^  /7»  "  ^  • 

(128) 

It  should  be  bom  in  mind  that  /  is  dependent  upon 
the  above  results  are  optimum  only  if  fa  =  ^ ' 


and  that 


* 
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U)  The  Effect  of  an  Initial  Phase  Error 

In  an  FM  system  with  a  stochastic  modulation  input  one  intuitively  expects 
that  the  effects  of  an  initial  phase  error  will  not  be  propagated  indefinitely. 
In  fact,  for  infinite  signal-to-noise  ratio  where  the  "instantaneous"  phase 
variations  can  be  observed  exactly,  the  initial  phase  specifies  the  constant 
of  integration  which  is  equivalent  to  the  occurence  of  a  delta  function  at 
the  origin  (  r«  t-T  )  of  the  modulating  signal.  For  finite  signal-to-noise 
ratios  one  then  expects  the  effects  of  the  initial  phase  to  decay  at  a  rate 
which  is  determined  by  the  autocorrelati on  function  RA(t  ,t) » e  *** 
and  the  channel  quality  factor  A  . 

If  in  Equation  (81)  then  Equation  (82)  takes  the  form 

<L*(z,i)  -  '  J du,  +A<tJ dx, 

\(*>  r)oLI  {(x)dx.  (12 

2en  i-rt-r 


In  Equation  (129)  let  a,*(r,i)  -  CL*(t,t)  +  €(rd)  where  cl*( r,t)  is  the 

coherent  solution  of  Equation  (129),  i.e.,  for  A<f>*0  .  and  e(Z,t)  is 
the  variation  of  Cb*(  t,t)  due  to  +  0  .So  that 


o£(7,  t)  =  f  R(S*>  fa*) duj d% 

+  [  Rj^,r)cii  rfc)cLt 

e(T,t)  •  f  Rj2,r)cC*$A  f  e(a,4)eLa-A4>\dx 

26 r>  Jt-rv-r  ^  v4-r 

•  Aj  h(x.,v)f  e(u,t)du,cLx+  B  I  h(x,Z)etx 

*4-r  Jt-T  0 t-r 


(130) 


(131) 


where 


A 


t 


36 


RADC-TDR-63-147 


re* 

-Ur-t+r) 

-Mz-t)  1 

2 

2-t  -e 

J 

*L 

2 

e-l(r-z)  _e 

i 

J 

»  7- 

,  X<T 


•0 

From  the  sketch  of  h(%,V)  ,  for  7~t  /  »  , 


(133) 


W6  note  that  except  in  a  region  of  width  proportional  to  f/A  centered  on 
X.  •  r  , 

i «  ^  * . 


A(x.r)*  eSrJx-z) 


.  f  i,  -t  > 

where  the  unit  step  function  »  j  Q  &  <. 


>0 


We  shall  here  approximate  />(*.  F)  by  e*$(t,-v)  }  this  saves  a  considerable 
amount  of  computational  work.  An  exact  analysis  leading  to  similar  results 
is  presented  in  Appendix  I. 

Substituting  Equation  (133)  into  Equation  (131)  yields 


€ 


(x,4)  -  A  f  dxf  e‘r0(*-r)6(u,4)etto+8f  e‘r0(K-z)dx 

Jt-r 

*A  f  duf  e* it -z)6(uti)cU  + 
i t-r 

sAe«[f  i)du.  +f(t- u)6( co, J)da.j  -b •  r) 


(13U) 


Equation  (13U)  has  solution 

*(V.t)*-jS(V-t+T) 

where  6(  )  is  the  unit  delta  function.  The  occurence  of  a  delta  function 

is  due  to  the  approximation  of  h  (x>,Z)  by  6^0(%-Z)  ,  The  actual 

solution  would  also  approach  a  delta  function  as  -A  —*• *•  •  With  A  finite 

one  will  encounter  a  transient  of  duration  proportional  to  //A  .  In  this 

case  6  (t,  &)  —O  as  T  -  (4 -r)  ^  y  and  the  mean  square  error  is 

A 

unchanged  for  such  f  , 
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5)  Relationship  Between  Maximum  Likelihood  and  Conventional  FM  Reception 

Above  the  Threshold 

A  complete  analysis  of  the  behavior  of  an  ideal  discriminator  (a  device 
the  output  of  which  is  proportional  to  the  rate  of  change  of  phase  at  its 
input)  has  not  yet  been  performed.  However,  very  recently,  S.  0.  Rice  has 
reported  the  results  of  his  detailed  investigation  of  "Noise  in  FM  Receivers" 

The  analysis  presented  here  was  completed  before  the  results  of  Rice's  work 
became  available  and  does  not  attempt  to  treat  the  behavior  of  FM  receivers 
near  threshold.  The  present  Interest  is  to  obtain  the  limiting  performance 
obtainable  with  a  conventional  FM  receiver  for  comparison  with  the  results 
obtained  from  the  maximum  likelihood  analysis.  Since,  in  that  analysis,  it 
was  assumed  that  the  operating  conditions  are  sufficiently  good  to  permit 
linearization  of  the  governing  integral  equation,  the  above  threshold  behavior 
of  an  ideal  discriminator  is  of  primary  concern.  A  simplified  analysis  similar 
to  that  reported  by  W.  R.  Bennett  will  be  used.  The  noise  spectrum  of  the 
discriminator  output  obtained  by  our  analysis  is  the  first  term  in  an  asymptotic 
expansion  of  that  spectrum,  which  is  valid  as  the  carrier-to-noise  ratio  becomes 
very  large.  The  noise  output  from  a  discriminator  can  be  obtained  by  considera¬ 
tion  of  the  statistics  of  the  rate  of  change  of  phase  of  the  vector  resultant 
of  signal  plus  noise.  The  output  noise  consists  essentially  of  a  small 
gaussian  noise  current  and  a  succession  of  impulses  or  clicks  which  occur  at 
random  whenever  the  resultant  encircles  the  origin.  In  the  simplified  analysis 
presented  below,  the  possibility  of  the  occurrence  of  clicks  has  been  eliminated 
by  neglecting  the  in-phase  component  of  noise.  Actually,  the  rate  of  occurrence 

r 7 1 

of  clicks  decreases  exponentially  with  increasing  carrier-to-noise  ratio. 

The  rapid  onset  of  clicks  with  decreasing  carrier-to-noise  ratio  reduces 
the  output  signal-to-noise  ratio,  and  this  is  the  primary  cause  of  the  EM 
threshold. 

In  order  to  obtain  results  for  the  FM  receiver  comparable  with  those 
obtained  for  the  case  of  maximum  likelihood  estimation,  we  will  assume  that 
the  channel  conditions  are  so  good  that  operation  is  above  the  threshold. 
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The  use  of  zero  delay  and  infinite  delay  least  mean  square  error  (Wiener) 
filters  connected  to  the  discriminator  output  will  yield  results  for  compari¬ 
son  with  zero  and  infinite  delay  maximum  likelihood  estimation. 


The  design  of  the  Wiener  filter  requires  specification  of  the  power 
spectra  (or  equivalent)  of  the  signal  and  noise  components  at  the  input  to 
the  filter*.  An  approximation,  valid  for  high  carrier- to-noise  ratios,  of 
the  discriminator  output  noise  spectrum  due  to  white  gaussian  RF  noise  may 
be  obtained  as  follows.13-1  Setting  a.(r)  =0  in  Equation  (1),  the  received 
signal  is 

et(z)  =  £0  sin  u)az  -b  n( t)  (136) 

which  may  be  written  as 

ef(z)  —  £0  sin  u)Q  r+ns(T)  sin  eo0  V+  nc(r)  cos  oU0r 

=  [E0zns(l)]  sin  u>tr+  nc (r)  cos  u)tz  (137) 

=  A  (z)  sen  r  +  <p(r)] 


where 


Al(z)  -  [E0+  njx)}1  +  n*(x) 


=  -fan 


-1  n,(z) 

E0+  ns(z) 


(138) 


The  discriminator  output  is  proportional  to 

Mr)  «  lEo+ '>*(*)]”*(*)  ~  "Jv)  ^  nc(r) 
'  (£>  +  ”9(z)]Z‘  +  ”o(z)  Eo 


(1 39) 


The  results  of  the  analysis  are  summarized  on  page  50 
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for  large  carrier-to-noise  ratios 


The  spectral  density  of  t//(Z)  due  to  noise  is  then  obtained  aa 


«  £  w'»)  - 


(UtO) 


The  discriminator  gain  is  determined  as  f/d  by  the  requirement  that 
the  output  in  the  absence  of  noise  be  Cb(Z)  . 

Combining  these  results  we  find  that  the  signal  spectrum  S^Cuj)  and 
noise  spectrum  NJoo)  at  the  discriminator  output  above  threshold  are  given  by 


SJu>)  =  6  77 - t  watts/cps  (double-sided  spectrum)  (lljl) 

li  +u) 


*2  € 

N0(to)  —  a  watts/cps  (double-sided  spectrum) 


(1U2) 


The  total  signal  power  is 


A  f 
a  ZttJ^ 


oo  .  4.  a 


(1U3) 


The  least  mean  square  (Wiener)  filter  can  now  be  designed  on  the  basis 
of  Equation  (llilt)  for  the  infinite  delay  or  Equation  (151)  for  the  zero 
delay  case.  An  excellent  exposition  of  the  theory  of  least  mean  square 

raj 

filtering  is  presented  by  Bode  and  Shannon  in  Reference  .  The  pertinent 
results  of  that  paper  are  abstracted  below. 


Assuming  stationary  statistics  for  both  signal  and  additive  noise,  the 
transfer  function  of  the  least  mean  square  infinite  delay  filter  is  given  by 


Y(u>) 


5(u>) 

S(oo)  ■+■  N(cu) 


(1W) 
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where  S(o>)  is  the  spectrel  density  of  the  signal  and  N(ui)  is  the  spectral 
density  of  the  noise.  The  total  mean  square  error  resulting  from  use  of 
this  filter  is* 


Woo 


r+°°S(uj)  N(w) 
w  J.f*  S(u>)  +  N (.<*>) 


(U5) 


The  least  mean  square  zero  delay  filter  Y^(ui)  is  obtained  as  follows. 
Let 


^(w)Y*(o>) 


_ 1 _ 

S  (a>)  +■  N(eju) 


(Ili6) 


where  Y/cu)  is  a  realizable  frequency  response  with  all  of  its  singularities 
in  the  upper  half  of  the  u)  plane. 


Yz(w)  -  Y1  1(io)y(u)) 


5fc>) 

5(cu)  +  N(u)) 


r,~f(cv) 


(1U7) 


r  *°° 

**(*)"&! 

,  inpulse  response  corresponding 
to  Ye  (u>) 

(1W) 

^  (t)  J  0 

,  realizable  part  of  ~ikz(t) 

(U9) 

,  frequency  response  corres¬ 
ponding  to  -k3(t) 


(ISO) 


Then 

Y¥(o))  =  Ys(&)  Yf( OJ)  ,  051) 

and  the  total  mean  square  error  H0  resulting  from  use  of  this  filter  is 
giver,  by 

H0  -  jsja>)l  1  -  Yy M|*+  N(*)\Y4(u>tf}d*<0  (152) 


The  factor  does  not  appear  in  Reference  [  9  ] because  the  spectral  density 
used  there  is  on  a  per  radian  basis,  whereas  a  per  cps  basis  has  been  used 
in  this  paper. 
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We  shall  again  be  Interested  in  the  performance  of  this  system  under 

off-design  conditions.  As  before,  we  will  evaluate  the  deterioration  when 

z 

the  system  is  designed  on  the  assumption  of  RF  noise  power  density  £n 


and  carrier  amplitude 


4 


and  actually  encounters  &n 


and 


*/^S 

is  then  NJui) 


Mn 

M? 


The  actual  noise  spectrum  of  the  discriminator  output 

MM* 


The  performance  of  this  system  with  actual  discriminator  noise  output 

A  . 

Nd\uj)  can  then  be  obtained  by  first  assuming  *  N*n  m  1  »  computing 

Na,  D0  and  then  setting 


A 

No. 


A 

Dao  “ 


K 


&  = 


(153) 


where  the  circumflexes  denote  actual  rather  than  design  conditions,  and 

No.  ,  Do*  ,  Na  ,  D0  are  the  contributions  to  the  mean  square  error 

of  the  infinite  and  aero  delay  filters  due  to  noise  and  distortion  respectively. 


as 


The  channel  quality  factor  X  was  previously.  (Equation  (83))  defined 


.  rasw  ** 


<2**6  * 


(151*) 


Let 


1 

L  zFZ7 


n  -J 


(155) 


i.e.,  X0  Ta^-ue  X  assumes  when  ^  -  -S-  -  /  •  The  nominal 

discriminator  output  noise  spectrum,  Equation  (ll*2),  is  then  given  by 


ND  (w) 


_  z  z 


(156) 
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a)  Infinite  Delay  Case 


Substituting  Equations  (lhl)  and  (l$6)  into  Equation  (lUU) ,  the  frequency 
response  of  the  filter  is 

Y<  ]  "s a(cu)+Al0(w)  *  e&V  (157) 

*+*  iiz\; 

'  (*K)* 

at**-  Tt^co1  + 

With  this  filter  the  mean  square  difference  between  the  filter  output  and  the 
signal  component  of  the  input  is  given  by* 

2  a  & 


,  r^s^)ND(uj)  ete  _ 

00  ZttJ. oo  ^(ui) t  N(aJ )  far  J-oo  iD*+i.*-<jjl+yLhtf 


_  ii  Lp 

Z7T  Y0  l  *  70  a 


(158) 


where 

^  *  yiAj  -hi  ~  ]/J A,  A,»7  (15?) 


so  that 


for 


The  mean  square  error  consists  of  two  independent  components,  H0 0  -  +Dao  . 
Where  Aoo  denotes  the  mean  square  output  due  to  noise  and  A»  the  mean 
square  distortion  of  the  signal  as  has  already  been  mentioned. 


*The  integral  I,  =J_oo  rt*uj*'7£jk\  &nd  the  integrals  -Z*  » 
Xj  >  If  >  and  X^.  which  will  be  encountered  later  are  evaluated  in 
Appendix  II. 
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No°x 2rrf  N0(co)  {T(u>)\%etto 


-  <***}  r 

27T  jL* 

*  *-4  *>  ♦* 

*  faJr.  CS-  r_ 
-2^  # 


°  a;* _ ,  , 

,  (a/V^V^VJ2 
-  ?°z-f  ig-*  =  i£i± 


~^7j  z 


+y?p* 


(160 


/VoO 


¥/z  K  4 


for  \»1. 


(I6i; 


u  aj  3  y0  •+■  1  p 

''o o  ~  f'*eo  ,,  !cl 


*r03 


(162: 


D. 


'  ¥/zAt 


for  A0»  •?. 


(163) 


b)  Zero  Delay  Case 


The  transfer  function  (&J)  of  the  zero  delay  Wiener  filter  will  now 
be  computed,  in  accordance  with  the  procedure  previously  outlined. 


Yf(co)  Y*(ui) 


1 


SJ*)  +  ND  (w)  eA  *  stt  *irv 


(I6I1) 


Let 


*>*++*' 

6*  <o*+*Avx+  *>*)<  + 

jjz  A*  -  1 


(163) 

(166) 


Then  b£  =  tL*'*/'  and  Z(b?+  b£)  -  4b*  =4*  so  that 
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Hence, 


and 


where 


uj*+  -  jat^+tbf+b/)]*  -  (Zbx<jjf 

•  {(tjt+tbf+bf)- Zbzu)\  {out+(b1l-hbJf)+2bz«J  J 

-  f O  -4 )  V  b/  }{(*+  bj V  ^  j 

=  (a)-bt  -ib1)(uj-bi.-f-ikj)(ui^bz  -Uf)(ov+bx+ibf) 


we  write 

/  » /*A*  -ifu>rU) 

S^ico)  ■+■  Nd  (cu)  l  6^  (tu-bz-ib1)(co+bx.-ib,  j. 

.  i~  ^A/ _ L(aJ-fik) _ 

L  €a.  G*'  -4t  +■  ibr  ){tu+bt+  ibt ) 


V") 


-iiAaa  _ _ 

fa  (uJ-bz- ibf)(  ou  +  bz  -  bb,) 


Tz(cj)  = 


Sa,^ 


3jiu>)  +  N0(at)  Y,(ou) 


_  e  -k?  }?- _ f _ 

*  0  (ou- i&)(ut  -  bz+ib,)(u>  + bz  +  Lbt) 


U)  -bz  +  ibi  cu  +  b^i-  Lb \ 


>) 


At  = 


-/ 


_  J'Z' 

1  (bf.- ibf  -  l£)(bx,+  lbf  -Hik)  'AlK*‘  70  +  1 

J_ _  To  -/  bt.  tibi  t  i jt 


Zbjbi-ibi-it.)  **\*70+1  Zbx 


'J  2b,(b,+ib,  -t-i-k)  =  tA*0Z  yo  +  f  Zb, 


1  Yo-t  bz  -ibj  -  it 


(167) 

(168) 


(169) 
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The  impulse  response  corresponding  to  Y'z(^)  is 


=  L 


ZtT 


V7-a_ 

J.  c,  \OJ-ilL 


uj-bx+ib,  cifi-tz 


t**V 


(no) 


Since 


and 


w/-oo 


/ 

«y-ar 


for  a.  -  bz  -ibt  or  a.-*-  bt  ~ibf  , 
the  impulse  response  i iss 

For  t  >s  O, 


-lb, 


%i(i)=  iej^KA.de  *v) 


.44.  4.-^ 


K  +  i  * 


(171) 


For  t  <  O  , 

*>(*)  =  i€jL\l[^(-iei(b^]t)  +Aa(-iei(’** 

+  (bt -ibt  -ik)t  ii>z*j  (172) 

Actually,  we  do  not  need  -Az  ( t)  for  -t  >  O  ,  because  the  realizable  fre¬ 
quency  response  7[(<d)  is  obtained  from  the  impulse  response 


0 


*0-1 

**+< 


e^-te 


for  t  <  o 
for  i  1 0 


(173] 
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So 


Y3(co)  - 

7o*T  Jo 


.  2kzi  €  -u 

70+1  *  uu-UL 

Finally,  the  frequency  response  of  the  required  filter  is 


Y¥(to)  -  Y3(u>)Yf(ou) 


.Yc-1  _ 

Yc  +  1  (ov-bfi  -ibt)(ui  +  b%  -U>t) 

%-*  ***/ 

%+f  -uJz¥-Z64  iu>+ 


The  mean  square  error  resulting  from  use  of  this  filter  can  now  be 
The  mean  square  error  due  to  the  noise 


K  =  jppf  N0(cu))y¥(oo)^ daJ 


_  j_  e£  /  r0-r\l  r~ 

Zrr  )J-to(At\0'‘-coz)t  +  Vbtxu> 


' Ztr***  ('frZT) Zo  uf*+ixw*++*'K* 


>£.e*(*=i.xz 

zrr  ^  [  %+t)  ^ 


~(2L!) xl±e*  -fe±)*-Lp 

\K+f)  Y0&  A  \Yo+l'  Y0  * 


M 


/2K* 

The  mean  square  error  due  to  distortion  of  the  signal 


for  A.  »  1  • 


dcu 


1  *  *> 

Zrr 


**/  “  zdrg*  I '  -  r- 


(17U) 


(175) 

determined. 


(176) 


(177) 


48 


RADC-TDR-63-147 


Since 


,  -  r,  c»)  i*- 1  *  M‘-  [Tjt“,)  * 


7TT 


Yo+1 

Yo~*  4*1  34 


2(-g>l+Alrf±. 

; - To  L  .  J  *7 


ye+1  ^  O'*-* 

-  **>  *«**  *  *?)J 


and 


*  /  /  J£ 

— 5 — TX  d**  *  * 


/: 


3Yo~*  jL  p 

'  ~kTT  y.  * 


Do 


’/zK 


for  Y0  Y>  1  • 


'  0, 


The  total  mean  square  error  ^  ^ 

H.*N.*D.  =(^p  “- 


M, 


'7z*c 


for  Y0»1' 


We  note  that 


M,  f_JjL-)  for  A,»/* 

rr^\Yo*i) 
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D.  */o% 5/,-f)  . 

Doc"  (r.+f)(3/0*+t) 


for 


(181*) 


c)  Off -Design  Performance 


Assuming  that  deviations  of  the  carrier  and  noise  levels  are  such 
that  the  assumption  of  a  large  carrier- to-noiBe  power  ratio  remains  valid, 
the  effects  of  such  deviations  are  easily  taken  into  account.  At  the  out¬ 
put  of  the  discriminator  the  noise  power  spectrum  is  now  j  ND(u>) 

while  the  signal  spectrum  s(u>)  remains  unchanged.  Therefore,  at  the  out¬ 


put  of  the  filter  we  have 

4  - 

4  -  c>i 


(  i  *  ©i  o°) 


(185) 


where  the  circumflex  denotes  off-design  conditions. 

The  results  obtained  for  the  discriminator  Wiener- filter  receiver  are 
sumnarlzed  below. 


Zero  Delays 


Do 


S 


3Y.-1 
(?o  +  1)7o 


P* 


Do 


(186) 


m-%  p 

Y.+V  7o  * 


(107) 
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(188) 


A 

Mo 


3Y0z+2r.-'+ 
(%  +  /)*• 


■5 


*r  ■%”>  * 


4Yo 

ii^D 


(189) 


Infinite  Delay. 


Noo  • 
boo  - 
Par  -MjL 

K  /^S 


3Y0*+ 

W 

1 —  Po,  *  Ooo 

(190) 

Ye*  ~1  n 

(191) 

/<** 

* 

3YoX 

■*■>+■  £$r(X,x-/)  B 
- * 

(192) 

A  /  \ 

Moo  m  ~y  PfU  3  MoO  J 

(193! 

We  note  that  when  /<3  -  1  we  have  y  -  yQ  ,  and  these  expressions 
are  identical  with  those  obtained  for  the  case  of  maximum  likelihood  estima¬ 
tion,  Equations  (122)  to  (128). 
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DISCUSSION  OF  RESULTS 


The  most  striking  result  obtained  is  the  complete  agreement  of  the  six 
expressions  describing  the  mean  square  error  H  and  its  decomposition  into 
distortion,  D  ,  and  noise,  N  ,  terms  obtained  by  the  two  different  analyses 
(maximum  likelihood  estimation  and  demodulation  by  means  of  an  ideal  discriminator 
followed  by  a  Wiener  filter)  for  the  case  when  operation  is  under  the  assumed 
design  conditions .  Since  all  the  results  were  obtained  by  the  use  of  approxi¬ 
mations  valid  only  when  operating  with  a  high  carrier- to-nois e  ratio  it  is 
desirable  to  obtain  an  estimate  of  the  range  of  reasonable  validity  of  these 
results.  Such  an  estimate  can  be  easily  obtained  for  the  discriminator- 
Wiener  filter  case  by  examining  the  approximation  made  in  the  derivation  of 
the  results. 

£ 

This  approximation  is  contained  in  Equation  (139)  where  we  set 

£-0  *  ncW  zis(z)  nc(z)  flPM 

This  requires  that  E0  »  (Z)}  and,  therefore,  it  is  essential 

that  the  bandwidth  of  the  input  white  noise  be  limited.  In  practice,  the 
noise  power  is  limited  by  the  receiver  i.f.  bandwidth.  The  required  i.f.  band¬ 
width  B'l  f  is  given  approximately  by 

Bit  =  2A  *  |  <W5> 

where 

A  ’  • '  maximum  signal  amplitude 
'H 

—  •  •  •  noise  equivalent  signal  bandwidth 
^  (two-sided  spectrum) 


This  approximation  is  good  only  "most  of  the  time"  since  it  obviously  does 
not  hold  when  n&(Z)  -*•  0  .  Reference  7  considers  this  problem  in  detail. 
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Since  a(v)  is  gauss ianly  distributed,  a  maximum  signal  amplitude  A  cannot 
be  rigorously  specified.  However,  the  probability  \a(T)\  >A  is  given 

by 


p{|cu(r)|  >a) 


1  -  erf 


bk) 


(196 


where  ^  ,  the  modulation  power,  is  also  the  expected  value  of  c£(Z) s 
If  we  choose  A  -  ¥■  the  probability  that  /a(?)l>  A  « 

is  less  than  10“?.  The  required  i.f.  bandwidth  j  is  then 

Bit  ^  cps  (one-sided  spectrum) 


77* 


(197! 


Since 


Noise  Power  in  i.f.  bandwidth,  and 


Carrier  Power,  the  r.f.  carrier-to-noise  power  ratio 


Ze*-Blh  ~  Z<nttz> 


(i98: 


Assuming  that  the  approximation  in  Equation  (191*)  becomes  valid  for  ^ 
the  required  r.f.  signal- to-noise  power  ratio  ^  lOdb.  The  above ‘rela¬ 
tions  can  now  be  used  to  determine'  the  approximate  minimum  value  of  the 
channel  quality  factor  A0  required  for  our  results  to  be  valid. 

Using  Equations  (198)  and  (197)  we  have 


Eg 


£o 

~Z 


7T  Z 


>  10 


(199: 


The  design  channel  quality  factor  A<> 
forms.  Thus,  starting  with  Equation  (l$$) 

'  AV 

**  * 


may  be  expressed  in  various 


K 


by  substituting  the  expressions  for  and  ys  one  obtains 
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Note  that  each  of  the  terms  in  Equation  (200)  is  a  dimensionless  parameter* 

By  substituting  /tfin  Equation  (200)  the  minimum  required  X0  for 
applicability  of  our  results  is  determined  as 

It  is  especially  to  be  noted  that  the  minimum  value  of  required  for 

above  threshold  operation  cannot  be  specified  without  considering  the  numerical 
values  of  the  parameters  appearing  in  Equation  (200). 


Similarly,  the  range  of  applicability  of  the  results  of  the  analysis 
of  maximum  likelihood  estimation  is  restricted  by  the  linearizing  assumption 

th*t  Sin^\atu)-CL*(u.*)]du  “  b.  Mflacd  ^ 

It  has  not  yet  been  determined  what  combination  of  parameters  are  required 
to  justify  making  this  assumption. 

Figure  1  illustrates  the  performance  of  both  the  maximum  likelihood  and 
the  Discriminator-Wiener  filter  receivers  operating  under  design  conditions. 
Plots  of  -jb-  ,  and  are  presented 

in  accordance  with  Equations  (12U) ,  (122),  (123),  (127),  (125)  and  (126). 

The  scale  of  ordinates  expresses  the  above  ratios  in  decibels,  and  the  scale 

d 

of  abscissas  expresses  Ae  ,  the  fourth  power  of  the  channel  quality 
factor,  also  in  decibels.  It  is  important  to  bear  in  mind  that  these  demodula¬ 
tion  systems  were  designed  so  as  to  minimize  and,  hence,  maximize 
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POWER  OF  NOOUUTIM  SI8NAL 


'h  and  that  no  attempt  has  been  made  to  control  the  division  of  H  into 
its  component  terms,  D  and  N  .  From  this  figure  it  is  seen  that  for  large 
A,  all  curves  approach  a  slope  of  J,  this  reflects  the  fact  that  H  , 

D  ,  N  all  are  of  order  l/Ad  .  It  will  also  be  noted  that  distortion 
accounts  for  the  major  portion  of  the  mean  square  error*  For  large  values  of 
Aa,  1$%  of  /y  is  due  to  distortion  and  this  percentage  increases  as  A0 
is  decreased.  Figures  2,  3,  U  and  $  describe  in  various  ways  the  effects  of 
operating  conditions  differing  from  the  design  conditions.  From  Equations 
(122)  -  (128)  and  (186)  -  (193)  it  is  seen  that  the  variation  of  the  mean 
square  error  and  its  components,  due  to  deviations  from  design  conditions, 
is  not  the  same  for  maximum  likelihood  estimation  and  demodulation  by  a  dis¬ 
criminator  followed  by  a  Wiener  filter.  Off- design  operation  can  be  due  to 
encountering  noise  and/or  carrier  strength  other  than  anticipated,  /  1 
and/or  /t.  /  /  .  Since  the  mean  square  error  H  is  a  function  of  three 
variables,  Ae  ,  ,  //>s  ,  a  complete  graphical  presentation  is  not 

practical.  In  Figure  2  a  design  value  of  A0  ■  10  is  assumed,  and  the 

/\ 

effect  of  varying  the  received  carrier  strength  EQ  EQ  is  displayed. 

It  will  be  noted  that  while  an  increase  in  carrier  strength  above  the  design 
value  does  improve  the  performance,  the  improvement  is  not  as  great  as  if 
the  receiver  had  been  designed  for  this  value  of  carrier  strength.  For  example, 
for  a/  ■  iiOdb  we  find  from  Figure  1  or  Figure  2  that  /«.//%  “  6.1db. 

If  the  carrier  strength  is  now  increased  by  lOdb  and  the  receiver  design  not 
adjusted,  then  Figure  2  shows  P^/  H0  ■  7.0db  for  the  Discriminator-Wiener 

filter  and  /^//^  -  7.9db  for  maximum  likelihood  estimation.  From  Figure  1 

we  find  that  if  the  receivers  had  been  designed  for  this  condition,  - 

$0db,  Pq,IHc  ■  8.3db,  with  either  system  of  demodulation. 

In  Figure  3  'the  change  in  mean  square  error  due  to  noise  and  distortion 
expressed  in  db  is  plotted  for  the  Discriminator-Wiener  filter  receivers. 

From  Equations  (186),  (187),  (190)  and  (191)  it  is  seen  that  this  is  a  function 
of  only.  These  equations  state  that  for  a  fixed  Wiener  filter  design 

the  mean  square  distortion,  D  ,  due  to  the  use  of  this  filter  is  independent 
of  variations  of  /un  ,  ,  but  that  the  stochastic  portion  of  the  mean 
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Figure  2  EFFECTS  OF  VARIATION  OF  RECEIVED  CARRIER  STRENGTH  ON  MEAN  SQUARE  ERROR 

DESIGN  CONDITION  :  lO  Mm  m  f 


u  mfc  ACTUAL  carrier  amplitude 
E0  m  DESIGN  CARRIER  AMPLITUDE 

u*m  C*.  ACTUAL  WOISE  INTENSITY 
n"  «„*  DESIGN  NOISE  INTENSITY 

A  -MEAN  SQUARE  ERROR  DUE  TO  NOISE  UNDER  ACTUAL  CONDITIONS 

”  MEAN  SQUARE  ERROR  DUE  TO  NOISE  UNDER  DESIGN  CONDITIONS 

A  -MEAN  SQUARE  ERROR  DUE  TO  DISTORTION  UNDER  ACTUAL  CONDITIONS 

O  MEAN  SQUARE  ERROR  DUE  TO  DISTORTION  UNDER  DESIGN  CONDITIONS 


Figure  3  DISCRIMINATOR-WIENER  FILTER  RECEIVER^  0  OR  oo  DELAY. 

EFFECT  OF  OPERATING  UNDER  OFF-DESIGN  CONDITIONS 

(CURVES  ALSO  APPLY  TO  MAXIMUM  LIKELIHOOD  ESTIMATION  FOR 
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square  error,  N  ,  is  directly  proportional  to  the  carrier-to-noise  power 
ratio.  From  Equations  (122),  (123),  (125)  and  (126)  it  will  be  noted  that  when 
-  1  these  plots  also  describe  the  performance  of  maximum  likelihood  estima¬ 
tion  with  variation  of  /*„  . 

The  effects  of  variation  of  received  carrier  strength  on  the  maximum 
likelihood  estimate  are  a  function  of  the  design  point  \0  .  The  variation 
of  the  total  mean  square  error  has  already  been  illustrated  for  the  case 
A0  ■  10  in  Figure  2.  In  Figures  1*  and  5  the  variation  of  the  components 
N0  ,  D0 ,  ,  Dao  with  variation  in  carrier  strength  is  illustrated. 

From  these  curves  it  is  seen  that  for  the  range  of  interest  the  dependence 
on  Aa  is  not  very  pronounced.  The  fact  that  the  plots  for  Ae-o o  are 

A  A 

straight  lines  reflects  the  asymptotic  dependence  of  N  ,  D  where 

N  oc  ^  '  and  0  06  ^ 

The  major  significance  of  our  results  are:  It  has  been  shown,  at  least 
for  above  threshold  operation,  that  the  statistically  optimum  demodulation 
technique  of  maximum  likelihood  estimation  yields  the  same  results  as  obtained 
by  an  optimized  "inverse*  receiver*  and  that  lack  of  knowledge  of  the  initial 
carrier  phase  results  in  an  increased  mean  square  error  of  the  maximum  likeli¬ 
hood  estimate  only  during  an  initial  transitory  period. 

The  fact  that  the  assumption  of  an  ideal  (Wiener)  filter  following  the 
ideal  discriminator  leads  to  precisely  the  same  results  as  the  maximum  likeli¬ 
hood  estimation  is  gratifying  and  serves  as  a  "check*  on  a  considerable  amount 
of  mathematical  manipulation.  One  would,  however,  not  expect  great  sensitivity 
to  deviations  of  the  filter  characteristics  from  the  ideal. 


By  an  "inverse"  receiver  is  meant  a  receiver  which  performs  an  operation 
"inverse"  to  the  modulator,  e.g.,  in  EM  the  modulator  produces  a  rate  of 
change  of  carrier  phase  proportional  to  the  modulating  signal  and  the  "inverse" 
receiver  produces  an  output  proportional  to  the  rate  of  change  of  the  receiver 
phase. 
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APPENDIX  A 


Exact  Solution  for  €(v.t) 


Equation  (131)  may  be  written 


Put 


then 


or 


A  2 

e(r.t)  *-E°E*P  • 


Z 


oUet,*~rSJ  ctu6(u.,i) 


ZolofiM 
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t-T  H-r 
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'^r^- **[  d*e 
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X  wf-r  i/i 

.*  tf  „*6  .  . 

-  -  A*)?  f  <Z>*[ oLxj  eLcot  ^  B(u,4) 

2  Jjr  Jf-r 


(A-l) 


(A-2) 


(4-3) 


(  A-U  ) 


(  A-S) 
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Letting 


0  ‘Fr> 


0(6  -x) 


duZ  *4 (u,4) 


L  J*'\*frdt[dx[*d 

H-r  4  4-r 

-  i  £  V/’W  *d%fcicce  Ur't)€(ou,t) 


(a-6.) 


D*(6-K)  ■  lYf  c l*f dx  f  dice  *^e(u,t) 


+  ^  V/  du  e(u.t4) 
2  'k  -r 


4(r-x) 


6(u,i) 


dec  e  (cl,  i) 


4-7 


-  **Ye  -X)  +  aV/*  dxf*d.ue(u,t) 
'Jr  J4-r 


fr-7) 


CP2- ji*,) (e -  x)  *  P  dx  f  due(u,t) 

'JZ  Jt.T 

(A-8) 

r  7 

(DS~  Jfc*4)fe - X)  -  *  4  V /  aUce(u,4) 

J4-T 

(A-9) 

({>*-**0% -x)  «  -**/e(z,4) 

(A-10) 

(D^th p4-iV)6-  (o^aY)x 

(A-ll) 
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Now 


(*  "  <V*^-r  M~~z  J  et‘u e" 

t  t  jc 

Dfe'tyfgf  <&*[  d>»  f  aUo€  *^6(4, 6) 

*  Ji-r  J*  Jt-T 

0(€.-X)rm^.r  m~7'£"X  f  cbtf  eit  f  dcce^*  t^‘r^€(u,i) 

**  ‘V-r  <yg.  Ji-r 

Therefore, 

It  is  clear  that 

to*-/Ve-C)?_*  =0,  (0-*'We-<4..<.r  --  0 

Now  from  A-3 

f&i>f  <AiJ oLx.C  *li~7rt 

*  ~r*4>J 1 **  (* -«) «“ 

+  {*%yfA?/L(6-s)e+A(r-*) 

ok  =  -j  fayfyjfdgu-*)***"*) 

d\  - 


(A-12) 

(A-13) 

(A-lfc) 

(A-15) 

(A-l$) 

(A-17) 

(A-18) 


(A-19) 


(A-20) 
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(o2-az)x  - 


(A-21) 


(A-22) 

(D*-tLDA)f  0 

(A-23) 

dtd-t)e  i 

X.(±-T>t)  f* ctea-de'4**'**7'* 

Z  Jt-r 

(A-2U) 

^.t.T  -{*&•#£*<*-)**<—** 

(A-25) 

(A-26) 

Therefore,  we  have  for  €  the  differential  equation 

)t  *  0  (A-27) 


and  the  following  four  boundary  conditions. 


[(D  +  *)6l  =  0 

(a-28) 

L  Jr«* 

[(o-^  L.r  ■ 0 

(A-2 9) 

|a>*-V)«]  -  o 

(A-30) 

L  JT.* 

[ce'-tV).]  .  *v  ^ 

L  r»*-r 

(A-31) 
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I 


t 


The  general  solution  of  A-27  may  be  written 

6  (t,  i  )  *  e  a,  cos  Cy  +  at  sin  Oy) 

A-32 

coscy  +  a¥  sin  cy) 

where  rf  -  V -t -r y  •  z --i  +  rt  c  •  c  + ic  ,  c* •  c-ic  >  -<v,  and  -d* 
are  the  four  roots  of  D^-Hzi)M^iL*Xtt "  0  80  thffc* 


A-33 


The  coefficients  o-j  are  functions  independent  of  7"  and,  for  the 
required  solution,  are  to  be  detemlned  by  conditions  A-28  to  A-31. 

From  A-32  one  obtains: 

Os  *  e  ^  {( ca, ,  +  cat)  cos  c y  +  (ca.z  -  ca ^ )  sin  c y  | 

-e"  ^((Sas -cay)  cosoy  -b  (Sau^odj)  sine y  J 

0%  «  j  e c?j(a,i+  /v*,*1-/  ' Qj%)tos Gy  +(o*i -jv/f-  1  cu1)sino<f'j 
+  j/ VX*- 1 ' a^jeos  cy  o>3)stnoyJ 


0*6  =  j-  e  +  &g)+  ai  )J  cos  otj 

+  jc (q*z~  j/vA1” /  8t/#)  -  O  ( 6^+ -j V??- 1 ' A>i)  |  Cyj 

-|c  (as  - -j  ¥>?- 1  Cb¥  )  -  c  (a*  f  A**  1  ' O'*  )jcos  Cy 

&3)i-£(ou3+-J MXm~ /ay ) j 34/7 cy] 
Ve  are  only  interested  in  the  cases  where  >  //<2  . 


67 


RADC-TDR-63-147 


Using  these  relations  together  with  A -32,  condition  A-28  becomes 
°lai  *  ct  H  *  C3  *  0 


(A-31*) 


where 


■Jz\l+i  +  l  A. 
c.  -  '  =—, —  cos  cT  - 

1  1n‘-i 


A  _ 

34/?  c7 


A_  /<?A*+  t  +  Z  A, 
c,  -  cos  cT  +  f  s  m  c  T 

2 


% 


[U\z+i  -z 

i  iZA'-f 


A  -r  A  — . 

cos  cT  +  sin  c T 


c ¥  •  cos  c , 


£ 

X**/  --2 

r 

(A-35) 


Similarly,  condition  A-29  becomes 


(c-H)e  "iraf  -a  ce'ZSTai-(c*^)a^-hccu¥  =  0 


(a-36) 


condition  A-30  becomes 

4^  ^  ^  a,  4- a,^  *  0 

where  =  cos  c  T  *■  y^A*-  1  sin  c  T 

bz  «  -  cos  &T  *■  sin  ST 

b3  =  coscT  -  sin  cT 

b¥  =y ¥^~f  cosST-haincT 

and  using 

£  y/VA  *-1 7  -  c  =  £  A *G  and  c  *  c 


condition  A-31  becomes 

_  -*£T  a  -££/■  ^  _  A 

-oe  af  t  c«  ■y  da-j  *  ca^ 


(A— 37 ) 


(A-37a) 


(A-38) 
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From  A-36  and  A-38,  one  obtains 


and 


where 


and 


where 


a. 


x  ry  ^ -  zJtSl'-xT  1  .e-°  t 

^[{z^T  *  !  zxl-i  'J  * 


•*  *  ~  i+Jzf+i 


Substituting  A-38  and  A-UO  in  A-35  and  A-37  results  in 

■ Z5T \ 


/4cty  V-  66^  -c*e 


r,_  t  z+Jzf+t  _  \  A* 


Bat  +  u.(bi-it»*tT)a%  -  -(V '  ^j^/T 


3 


•  i)H  J ■ 

-  uJ>,*^2\W-  <)t3  +2]^ >4  h 


-JtCT 


-ZCT 


Solving  for  cl  and  a,  from  A-U2  and  A-U3»  one  obtains 

fn*A4f/L  u  ~-*crw^  2+-/z\Z+t  .  \ 

%if  °*) 

-(c4  -cfe~“T)(ba+  tr  j  ■ 


*  V  /3 


(A-39) 

(a-i»o: 

(A-hl ] 


(A-l|2; 


CA-I433 


(A-lOi] 


(A-li5) 


(A-JU6) 
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where 


V  »  (cz  - c¥  e  ~2e‘ t)b -  (t>x  - b¥  a  ~ZST)  A 


(A-U7) 


After  and  aK  are  calenlated  from  A-U5  and  A-U6,  a}  and  Ay  can  be  calcu¬ 
lated  from  A-39  and  A-liO, 


When  T  -  "t  ,  A-32  becomes 

£  (t.i)  -  €  ~ST^df^dj)cos  $T  +  (dj+a^SISi&T | 


If 

then 


T>>a-fi»F+i 

e*zrme-*.Jv&7T  I=0 


and  we  have  s  A  ~  ttc^ 

8  K*  4b 

V  fcb  ~ 

-  Zu(f4XL^-/Z\i4l  )  (By  A-3?  and  A-37a) 
>  7  +  f/Z  ( Since  we  assumed  *Z>V 


and,  hence,  all  the  coefficients  d'  are  finite  so  that  £  (t,  t )  — O 
as  T-*~o°. 

1 

In  order  to  show  that  e  (?,-£)-*•  O  for  all  T -  (-6  -T)  *  (/ 
we  rewrite  A-32  as 

efr,*)  =  eS  *  ZT  (a,,  oos  cy  4  at  sin  Zy) 

'  +<z  c<5S  sin  cy  )  •,  0  4 Lj •£  7" 

le(rj)l*  e"^y  flaj  +  la,z|  +  las|  +1  a¥|]- 
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APPENDIX  B 


Evaluation  of  Certain  Integrals 


If  S  [m  ^ 

T‘m  jL  ai*+K*L*+K*)£  ^ 

_ a/ _ 

2>“  J.„  (a>*+K*)(u>UK*cu*  +  K*\i)  dUJ 

J'm  Jm  (w*+X*)(u>*+K*w*+K',)Z)<itU 

r  r  _ sat _ v 

T'~-  L  (S+KW+K**?4* ' 

By  writing 

u>UkW+K*xJ 

=  {ooZ+(bz2+  bf)  -  Zb2ou}  •  {u>2+(bt&  +  btz)  v-  2bteoj 
-  jcu  -  (be  +  ibf )}  '  { U)-(bz  ~ibf  j 

•  [uf- (~t>i  +  ibf)J  •  [a)  -(- bz~  ibf)J 


where 


*>f  = 

bz  = 


71 


RADC-TDR-63-147 


and  then  using  the  method  of  residues,  one  finds: 


r  -  rjr-  f  (bz+jbj  (-bt+ib,)‘ 

'  l(i2bf)(Zbi)2(bti-ib1)  (-Zb^Zt-bg+ib^UZb,) 


{-bt+tb,)L 


+bzbi 


\(bt+tb1)-(-b2+ib1)J  -  ZjJm 


'ZA/  +  / 


rr  /  i  i  \  _  jr  1 

2  “  Vbtbi  [bz  +ib,  ~ ~b2  +ibt  )  ~  K*  Af-jzA/ *  / 

T  _  rjJ-f  ~K‘.  ;  1 /  bg+ibi  -b2  +  ib<  )| 

3  '  U2K(K4\*)  i&btb,\{btHb,)*+Kz  (-bt  -hiby+K*)] 

P  /  ,  1  f  bz  +ib,  -  bi+lb,  1 1 

“  IK*\¥  ¥bz br  1  t^+LZbtbi  «±-iZbgb,  IJ 

*  rr{~K3h^i"zb1 


-  TT 


{~«h 7  * 


J_  1 

zb,  7 


7T  1  {  Aaz+1  „  \ 

T  -  r  ‘  L  ■  1  f  (-bt+ib,)-1  \  1 

l¥  "  ^ Uf  •  A/  ¥bz bt\ £  +  L2bt b<  £  -LZb£b,  Jj 

i 

T  _  „  -1  r _ <*■  Lb,) _  f  bj+ib,  bgtjb,  bg  +  ib,  1 1 

**  UiZbf)z(ebz)z+(bg  +  zbf)*l~  iZb,  2bg  Z(bg  +  ib,)  j  J 

_ ^ _ f.  _  - bgtib ,  -bgtib,  -bz+tb,J  1 

+(-2bg)*V(-bai-ib/)*(Ubt)tlr~  -Zbg  ~ Z(-b2  +  ib,)~  iZb<  IJ 

»  . ml  r;_j _ L..JLU/ _ i _ 

^  J  l-h2+thf  f>2  JJ 

TT  /  f  _A_\  - _ TT _ 

/£> £,*£>/  \b,~  b\  +  b,z)  =  hbts(bt*  *  b, 1 ) 


Zrri 

-<b+b?L 


2KJ(/Z\f+J)s{K2Az) 


K*  2A?({ZXT+1)Z 
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In  the  computation  of  If  ,  the  residues  at  the  second-order  poles  were  evalu¬ 
ated  by  use  of  the  relations 


Res.  at  &, 


and 


cL 

oteo 


to*'  _ ? 

-ti)z  (u>-%i)z(uj -%»)*■] 


_ 2u> _ j  A  c*j  to  uJ  ] 

~  *e)z(to-X J  )*i~w-K,  "  UJ-X-Z  '  u>-#a  j 


Defining 


y  *  V 1 

O  " 

the  above  results  take  the  fo ms 


77"  / 

*  % 


-T* 


_7T _ 2 

X3  7o(7o’-f) 


Is 


7T_  Z 
«3  7o<7.  +1)Z 


Ii 


TT  *+ _ 

X*  79(7.-1)(V.  +  1)z 


Is  - 


TT  1 

x*  y.3(ycz-f) 
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Ill 

THRESHOLD  EFFECTS  IN  FM  RECEIVERS  WITH 
RANDOMLY  MODULATED  SIGNALS 


SUMMARY 

The  threshold  phenomenon  in  an  FM  receiver  which  consists  of  an 
ideal  discriminator  and  a  post-detection  Wiener  filter  is  examined  for 
the  case  when  the  modulating  signal  is  a  gaussian  random  process  with 
zero  mean.  For  this  type  of  modulating  signal,  the  power  spectrum 
of  the  discriminator  output  noise  can  be  obtained  by  an  approach  due 
to  Ricel.  Three  difference  cases  are  treated:  (1)  the  power  spectrum 
of  the  modulating  signal  is  similar  to  that  of  a  white  noise  passed  through 
a  first-order  low  pass  filter,  and  an  infinite  delay  Wiener  filter  is 
used;  (2)  the  signal  spectrum  is  as  in  Case  (1),  but  a  zero  delay  Wiener 
filter  is  used;  (3)  the  signal  spectrum  is  constant  in  a  limited  band  and 
zero  outside,  and  an  infinite  delay  Wiener  filter  is  used.  It  is  found 
that  the  carrier-to-noise  (in  the  I.  F.  bandwidth)  ratio  at  which  thres¬ 
hold  occurs  depends  on  the  modulation  and  I.  F.  bandwidth.  Graphs 
showing  perforntiemce  near  threshold  are  presented. 


1.  Power  Spectrum  of  Discriminator  Output  Noise 


The  signal  transmitted  to  the  FM  receiver  has  the  form 


} 


in  which  U)c  ,  j3  ,  and  c<  are  constants.  The  discriminator  gain 
can  be  determined  as  /3~*  by  requiring  that  its  output  reproduce  the 
modulating  signal  )C(X)  in  the  absence  of  noise. 


Rice  conjectures,  Equation  (2.  31)  of  Reference  1,  that  the  two-sided 
power  spectrum,  No  (°V  )  ,  of  the  output  noise  of  a  discriminator  with 

gain  /j*~f  is  given  by* 


Nr 


{-nr1  (a/,  +  n.)+  Wy 


((£) 


(1) 


y— .  . . — 

Note  that  one-sided  spectra  were  used  in  Reference  1,  and  two-sided 
spectra  are  used  here. 
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where  E0  is  the  carrier  amplitude  and  N+-  and  A/_  are  the  expected 
number  of  times  per  second  that  the  discriminator  input  noise  phase 
increases  and  decreases  by  an  odd  multiple  of  7T  radians,  respectively. 

Wy(c&)  )  is  the  two-sided  power  spectrum  of  the  input  noise  component 
in  quadrature  with  the  modulated  carrier, 


yU)  =  nQ(t  )co5y(t  )-nc(t)  swy(t) 


(2) 


where  lp(t  )  is  the  carrier  phase  at  time  t  resulting  from  the  modu¬ 
lating  signal,  and  Y)c  (i  )  and  7?s  (t  )  are,  respectively,  the  in-phase 
and  quadrature  components  of  the  noise  with  respect  to  the  unmodulated 
carrier. 

We  are  concerned  with  the  case  where  the  input  noise  to  the  receiver 
and  the  modulating  signal  are  both  gaussian  with  zero  mean.  In  this 
case,  A/y-  =  N-  .  The  noise  is  also  assumed  to  be  white  with  power 
spectral  density  <£„ 

We  are  going  to  consider  two  gaussian  random  processes  having 
different  power  spectra,  but  the  same  total  power,  as  generating  the 
modulating  signal.  Let  the  power  spectra  be 


s*(^)=  £«  IprrK 


( _  oo  <  ao  <-  0,0  ) 


Sa  (<*>  )  = 


st  -  T=TT  '  a'  </<"/*  A2 

0  ,  ELSE  VJHERE 


where 


XL,  =  irllz 
J7,  *  A 


(  0  ^  ir  <  /  ) 


(3) 


(4) 
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so  that  the  total  power 

P=  Jnf  MaOc/ai*  Sb  (<*>)</&  =  -L  e}  K  (5) 

(The  spectra  have  been  normalized  in  such  a  manner  that  the  total 
powers  are  the  same  so  that  the  results  obtained  will  be  applicable  to 
all  cases.  ) 

Let  Btp  be  the  bandwidth  of  the  I.  F.  filter  which  is  assumed 
to  have  a  rectangular  passband  and  to  be  phase  compensated.  The  power 
spectral  density  of  (i  )  or  Y)c  ( t  )  at  the  discriminator  input  is 
then 

2  FOP /(a)/  £  IT  B1F 

(6) 

o  for  l<t>\  >r Blp 


and  the  carrier-to-noise  power  ratio, 
is  given  by 


,  at  the  discriminator  input 


(7) 


In  order  to  avoid  distortion  of  the  signal,  the  1.  F.  bandwidth  must  be 
wide  enough  to  cover  all  essential  spectral  components  of  the  modulated 
carrier.  On  the  other  hand,  in  order  to  keep  the  carrier-to-noise  ratio 
at  the  input  to  the  discriminator  large,  it  is  desirable  to  restrict  the  I.  F. 
bandwidth  as  much  as  possible.  If  the  signals  were  limited  to  an  ampli¬ 
tude  i.  A  and  maximum  frequency  ~27TT — ~  •  t^en  B/p  would 

be  given  approximately  by 


jg 

zr 


2.  A  + 


A 

2. 


(8) 


Although  the  spectrum  {(&)  )  has  no  well-defined  maximum  frequency, 
its  noise  equivalent  bandwidth  is  £  cps  (two-sided  spectrum).  Since 
the  modulating  signals,  s?  {  C  )  and  6(  t )  ,  are  assumed  to  be  gaussianly 
distributed,  a  maximum  amplitude  ft  cannot  be  rigorously  specified*. 

^Distributions  encountered  in  practice  differ  from  true  gaussian  distri¬ 
butions  in  that  their  tails  do  not  extend  to  £  . 
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However,  the  probability  that  /tf  or j <6(T)/' > fl  is  given  by 


p{l«(T)l>A}=  j|=) 

which  is  less  than  10*^  if  we  choose  A=  4^2  P .  The  required  for 

this  choice  of  /)  is,  by  Equation  (8), 

Bzp  =  fl  J2P  +  (9) 

It  is  believed  that  when  Bip  is  specified  by  Equation  (9),  the  distor1- 
tion  of  the  output  signals  due  to  the  I.  F.  filter  is  negligible.  Since  one 
may  wish  to  choose  a  value  of  BZp  different  from  (narrower  than) 
that  specified  by  Equation  (9),  in  the  analysis  we  will  use 

Si f  =  y  do) 

with  777  unspecified.  Defining  O  ,  a  nondimensional  modulation 
parameter,  by 

9  =  J2P  =  -^jr—  k  .  (11) 

Then  Equation  (10)  may  be  written  as 

B„.  -£(mS  +  -f)  (12) 


For  the  case  of  a  gaussianly  distributed  modulating  signal,  accord¬ 
ing  to  Equation  (5.  13)  of  Reference  1, , 


1  Sip 

w  nr 


//■/  2cuf  a/u 


(13) 
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where 


*  19  (2  r£rf/{7zf 


Since 


—  ' _ nmz. 

Z.p  (t+  2«J>)  /  */> 


we  have  for  large  /> 


(14) 


Nj. 


frr~ 


/ 


4J° 


(15) 


which  is  the  same  as  Equation  (5.  14)  of  Reference  1.  The  approximate 

value  of  At  given  by  Equation  (15)  is  higher  than  the  exact  value,  but 
the  difference  is  less  than 

too 

)  percent. 
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of  the  approximate  value.  By  the  use  of  Equations  (12)  and  (14)  one  can 
write  (15)  as 


AA 


A 


)r+ 


According  to  Equation  (7.  6)  of  Reference  1, 

/PC 

Rr>3(r) ^  “  tip  cos  oo  x  dn 

where 


'IT  £, 


Rr>e  (r)  =  *£v  /  COS  to  V 


c/to 
2  7T 


(16) 


(17) 


±.  c/Nr  b„  t 


t»s  (*)-»  2.  £*  s(?)  AS  Brp  - 

A  OO 

%ep(o}-  %<j?  (H  =  //?  /  S(oo)(/- cos  tor) 


c/  to 
2  IT 


fy(o)  -  R<f(T)  *  O  FOK  ?~o 


>  0  FOR  /r  /  >  0 

With  S(to)  -  3a  (c^j)  as  given  by  Equation  (3)^ 


X?  (° )  - x,(r) -  4r^J(^  ew‘  -¥- 


IT  (<Z) 
'o 


r  \ni  2  k  2  +  k  2  e  / 


=  (t/rl-'  A  e'i/r/ 


) 
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and 


wy(«)^£»2 


S/A/  7T  Biy  7  COS  (t)Z  c/z 


(oo )  — *■  2.  £f)  *S 


With  S(u)  )  =  (cd)  as  given  by  Equation  (4), 


Rep  (o)  -  Rp(r)=  Aj^- 


'$k 


>v*k 


00 


(  /  —  cos  co  no  )  c/<o 


_  ih\A  ±-  izJL  _  J_  (j_  c 

-  r  \7T  k  V  rr  k  \v  cos 


V7T  kt 


cos 


fun 

ir*t-}i-/rl  1  S/Nx 


'v 


ae  F(/r/) 


fW 


and 


W*  (»)--£<£ 


e~F(t)  s/a/  ir  s, 


’IS 


T  CO*? aot  d  t 


vo 

Wy  (<w  )  — ►  2  £*  /> s  £1F  — *•  “® 

Since  BIF  is  usually  much  wider  than  the  bandwidth  of  the  output 

filter  (in  our  case,  a  Wiener  filter),  we  will  approximate 

Wy  (ce)  )  «  2  £*  ,  -  «  <  co  <  ®o 


for  either  modulating  process.  This  assumption  simplifies  the  mathe¬ 
matics  and,  when  used  with  Equations  (15)  or  (16),  yields  results 
slightly  on  the  conservative  side.  The  expression  (1)  for  the  discrimi¬ 
nator  output  noise  power  spectrum  now  becomes 


(18) 
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(19) 


#!>(<*>)  ~  ) 

where 

y2  s  -ft-  *  rzN+ 

cn 

^{rk-^9  e^Jt  +  ■&(?»  + f  [  By  (16)] 


or,  using  (7)  and  then  (12), 


~  k  (T~  q1  f  ze  V*e>°  J'  +  Jj*  (™+  Je  )“ 


Defining  the  channel  quality  factor  A0  by 

,2.1  r-2- 


x*  m  -/Os  e£ 
“  2f,2  ** 

et/i 


_ 

2  £» 


finally  yields 

N0  (<*>)  ~  -fg" /eJ2  ) 


(20) 


(21) 


(22) 


£ 

We  note  that  ^  ,  given  by  (20),  decreases  rapidly  as  J5 

increases  and  its  contribution  to  the  mean  square  error  of  the  output 
becomes  negligible  for  sufficiently  large.  In  Chapter  II,  the  con¬ 

tribution  of  the  Iff2,  term  in  (22)  was  neglected,  and  the  results  there 
obtained  are,  consequently,  applicable  only  for  large  J° 

As  J*  is  decreased  below  a  certain  value,  the  term  can 

no  longer  be  neglected  and  it  has  the  effect  of  depressing  the  output 
signal-to-noise  ratio  below  the  values  previously  computed.  Further 
decreasing  the  value  of  ^  results  in  a  rapid  deterioration  of  the 
output  signal-to-noise  ratio. 
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2.  Threshold  Investigations 

\ 

The  threshold  phenomenon  will  now  be  quantitatively  investigated 
for  the  following  cases: 


Case  I 

Modulation  Spectrum 
Wiener  Filter 

$a  (k>  )  » 

Infinite  Delay 

Case  II 

Modulation  Spectrum 
Wiener  Filter 

$4  C  ^  }  ' 

Zero  Delay 

Case  III 

Modulation  Spectrum 
Wiener  Filter 

SA  ((d)  , 

Infinite  Delay 

The  computational  procedure  used  to  specify  the  Wiener  filters 
is  the  same  as  used  in  Chapter  II. 


Case  I  Modulation  Spectrum  Sa  (  (e)  )  ,  Infinite  Delay  Wiener  Filter 
The  frequency  response  of  the  infinite  delay  Wiener  filter  is 


y  (cd  )  = 


-  ^  (a>) 


(23) 


With  this  filter  connected  to  the  output  of  the  discriminator,  the  mean 
square  error  between  the  filter  output  and  the  modulating  signal  is 


= 


3n{to)N0(a))  j 
(to )+  Nd((*s  ) 


(24) 


Using  Equations  (3)  and  (22), 


(*>*+*>*  *>*+*?  **  ) 


(25) 
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where 


Using  Equation  (5) , 


Ha 


.  JL/Jt 


Using  Equations  (26)  and ,(27) 


Hence,  by  defining 

A  -«*-£■ 

r,  =  jz  A?  TTi T^r 


(26) 

(27) 


(28) 


(29) 

(30) 


♦ 

See  Appendix  II  of  Chapter  II  for  the  evaluation  of  the  integral. 
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the  output  signal  power  to  mean  square  error  ratio  is 


P  1 _ 

H  ~  i  +  i  j at  ^ 

~7,  ~P~ 

If  we  take  If)  =  0,  this  reduces  to 

which  is  identical  to  Equation  (158)  of  Chapter  II.  From  Equations  (31) 
and  (32), 


^oo  =  10  LOG 


P/Pa 


fo 


10  10G. 


to 


(P/Hoo  )ys0 

(1-1  ~z  )—  ~ 


1+L0& 


AZ  )  '■ 


2*7+1  + 
2.  *1  +  1 


^41 


(33) 


By  use  of  Equations  (20),  (21),  and  (29),  Paa  can  be  expressed  as  a 
function  of  _P  ,17?  and  6 

When  A*  »  iJZj  7^f  ~  and  Equation  (31)  yields 


3  /  y* 

Threshold  may  be  considered  to  occur  when 


Y- 


(34) 


10  LOG, 


P/P 


where  A  is  positive  but  smaller  than  1,  so  that  V  <  1.  When 

A  «  /  ,  (34)  applies  for  practical  cases  (where  »  f^2  )  so  that 
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threshold  occurs  when 


3  /  7jf- 


4  K  k. 


L.1 


(35) 


Substituting  Equations  (20)  and  (21)  into  (35), 

TT’'5"  ®'4  71  ~  A 

where  J>r  indicates  the  value  of  J>  at  threshold.  Defining 

and  taking  logarithms,  one  obtains 


(36) 


fir  = 


2.  LOGe. 


LOG— - 2  LOG  A  +3GOGm  -b  bOG  b  +  LOGG 


(37) 


Thus,  one  can  find  PT  for  given  ~m  and  6  by  trial.  When  4 ^0  ^  1024, 
m ^  2,  and  A  6  .045  (or  0.20),  log  b  varies  only  slightly  so 

that  J>7  varies  approximately  as  log  ©  for  fixed  m 


Case  II  Modulation  Spectrum  ■Sg  (it)  )  ,  Zero  Delay  Wiener  Filter 

In  order  to  define  the  transfer  function  of  the  required  Wiener  filter, 
we  first  find  a  realizable  frequency  response  V,  (cei  )  which  satisfies 


>»(<■>)  vfo  ) 


_ / _ 

(«  )  +  Nd  (u>  ) 


Substituting  (25)  in  this, 

y,  (»  j  /,*<•>  )  = 

Therefore, 


a?*  /  k2 _ 

4)*  /  kf  co2  -b  kf  Af, 


y,  (&> ) 


k.  A*  _ -e  (a)-  <k  ) _ 

(  oo  -  Bg  -  <  B,  )(c0  +  £z  -  e  B,  ) 
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where 


B>  =  p~*?t 77  ,  p  x*„  - 


_  i, 


We  next  write 


V  ///iN  _  _ *5*  (#0 _  / 

4  ^  s*  )  +  ajd(oo  )  y,  ((£)) 


j  ,i 


«  i‘  <?*  k  A, 


(  -  i A  )(&  -  Bk  +  <8,  )(CV+  8 1  +  <  8,  ) 


y  t  8, 


where 


a  -  _ L _  _  / 

'  (Bz-i8,-  ik  X-8£ -<  B,  -id. )  ~  k 2  (77  zf  +  r,  ) 


2BZ  (Bz-iB,  -ik  ) 


^  2BZ  (Bs  +  iB,  tik.  ) 
Since 

'  o© 


«./ 


'=•  -  a, 


B2  +  e  S,  /  /  j 

•8Z  ~  <  8/  ~  ^  AL 
2  A 


(<  e“*r  )e-'™c/t  = 


Cl)-  i A 


and 


-—^-5-  (<-t  4-/i,  ) 


CL-  8 


Oo 


the  impulse  response  corresponding  to  the  frequency  response  K  (^e>  ) 
for  t  ^  0  is 


**.«)  =  <$  4J  4  (,• e-^  )-  -^-4 ^  e-“‘ 


(38) 
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Our  next  step  is  to  find  the  frequency  response  Vj  (<t) 
to  the  impulse  response 


(t)  FOR  t  2-0 


O  FOF{  t<  0 


) 


corresponding 


Thus, 


A  k.  M 

i+  Aj  +  r, 


1  ©c 


A  A  At 
~7+  Af  +  r, 


t 


Finally,  the  frequency  response  of  the  required  zero  delay  Wiener  filter 
is 


yf(to)—  y3(«>)  Yt(U>) 


_  a*  xi 


1+  K  +  '<F,  \a>  +  Bz T,  ) 

At  / 


//  +  T,  -ctr  +2B,t  (e)  A0, 


(39) 


With  this  filter  connected  to  the  output  of  the  discriminator,  the  output 

/V0  due  to  noise  is 
>00 


/  2 
No  -  -Jf  N0  (aj)/yf  (a>)j  dca 

d-ov 


of 


CO 


Al 


('  +-  Af  +  r,  f 


/  + 


i 


i el 


H 


(40) 


(41) 
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The  contribution  to  the  mean  square  error  of  the  output  due  to  distor¬ 
tion  is 


Do  — 


Since 


2T 


p  oo 

X  j  ~  f  deb 

fj —90 


(42) 


I  f-y, ^m/2= 


£*S _ / _ 

O  +  Af  -h  r,  f  to4-bkf-  a*3-*  kl  A, 


f  Xt  2{-c03-+k*XLo, ) 


>+  J?  *  r,  »4+  A4 


6f 


_  ,.zi  .  _ tie)*- 

—  /*/  ?f  +  r,  a4*-  k,  <*>*■+ 14  z4, 


X- 


— f 

/+?.,+  ?>  r  >4 


u  x  X*  .  *i  \  1 

[  az  /+?}*  rf )  to'+k^a)1--/*.; 


?! 


a>4+fia>z¥/L4  A4 


or 


Do  =  A2 


ZfT 


,jr  z*i  r 

[k  +  k  nnr+  r,  Cz 


_  jl4  ?° _ ( p  A/  _  /)  0  \  S\ 

h  t+  4  at,  l2  a2  tt  /)/  /  r,  rj 


where 


(43) 


Cz  = 


OJ‘ 


-{Cu'+Pytf+kftoi+k4,  A,  )  ^ 


=  2r< 


—  f- 

l( 


i^2  *  l  Bf 


L  iZkW  -4,  )  *  i  8  B,Bz  \(Bz  +  t  B,f  +  k‘ 

_  ~  Bt  +  c  B/  "1 

'  (-D2/c  B/  )2  +  A3-]  _ 
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k  / k, 

2  A2,  +  1 


(44) 


T 


Af,  k?AzJf 


>1,  kf/k4  ~{kf/k2  - 1  )  A* /A 


and 

C,  = 


r  oo 

\  =  /  WTTtJtT^TT:  jr  )  d*> 

J-oo 


*  .  1 

f  (*  +  '  B, )"'  r  (B2  -  £  B,  )“'  " 

“ 

^  k  if  A4,  4 B,  S2 

kz-  tf/2  +  /  2  B,B2  A*~  k,/2  -c  ZB,  Bz 

- 

Z7-  / 

r  / 

L  *2AZ 

__  k/k>  At,  k2/ k 2  /  (kf/k  -1  ) 

/njT/  a40,  kt/kf -(kf/kZ-f) 

Using  the  definitions  of  i,  ,  /}<,,  ,  A,  ,  and  T,  , 

-j-fi  Z  =  r, 


so  that 


Q 


r  /  t  At  +  f _ f\ 

k3  {  ?}  At  A4,  I 


one  finds 


(45) 


(46) 


(47) 
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Using  these  values  of  and  C0  as  well  as  £%  k/z  —  P 
the  expression  of  D0  ,  Equation  (43)  becomes 


Hence,  the  total  mean  square  error  of  the  output  ,  He  *  obeys 
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so  that  the  ratio  of  signal  power  to  mean  square  error 


+  V  +  f 


If  we  take  y/  =.  O  ,  then  A,  =  A  <3/  1~  —  1  £  Af  ~+1  =  do  .  and 

the  above  formula  reduces  to 


■Ap  +  Eg  if 

a  To 


(%  +  /Y 

4  t0 


which  is  identical  to  Equation  (180)  of  Chapter  I  .  Thus,  we  have 

P  /Ho 


Ho  —  10  IOG, 


to 


\=0 


=  }olorr,n 


to  ra  +  /  f0 106,0 


A/  //  _Jf£ 


* 


2  Vo 


(50) 


(51) 


(52) 


so  that,  by  using  (20),  (21),  (29)  and  V0  as  / 2.  A*  ¥■  f  ,  one  can  calculate 
for  various  and  given  7n  and  0 


Case  III  Modulation  Spectrum  &b(i4)  )  ,  Infinite  Delay  Wiener  Filter 

The  power  spectrum  Sb((s)  )  is  given  by  (4),  and  the  required 
frequency  response  of  the  infinite  delay  Wiener  filter  is  for  this  case 


or,  by  (4)  and  (22), 


v  .  >  _  _ $6  ( w  ) 

<t>'  Sb(ot))  f  Nd  (a>) 


tt2  Xt  +  (/-  ^)(^Z/  ) 


i  >4 

SL. 


A 


rr-jrj  n*  *•-£  t.  «,/*>/ 


rr 


y  )  = 

L  0  ELSEV/HERB 

The  mean  square  error  between  the  filter  output  and  the  modulating 
function  is  then 


(53) 


=  -jjf  I  ND(oo)  y  {u))d  <J» 
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.  2 

iL  2  / 

^  <Lf4 


i. 


_ \p2J-cuz _ 

*‘A i+d-vH-pi+ou*)  daJ 


—  c>o* 

~tF 


6a f  '  *V 


Z-?/'  /-ZA  at^*+(l-\r)(-^t-hUil) 


} 


oLto 


it^/d-v) 


=  ~r  U  1 V?^  i'V+iC*  (TAN'-f^.  *rKr^i 


-  ™~'nz7i 


yfa 


Let  (<4-fl)  *  TAN~U *  and  using  £  =  TAN(A-b)-  1  3 


■h 


z/rr 


Hao  '  PT7"(7^j^  faf  +  (i-v) ’ytJZ 


ttan^c 

* 


(54) 


where 


y(  1-  v)3/*y A,,*-*-  (1-is-)  yt-JIL2- 

A0*  -t-(i-ir)  yt/A1-  ■hCf-i*')  tS'Tr*/*/ 


(55) 


Define 

Ao  +  O-v-)  Jrj 

Then,  (55)  and  (54)  can  be  written  as 

-  TT /.  .  \S/l  1  _ 1 

S-zCi-t*)  i-‘iirz(4-u’)viia* 

and 

p_  A^  +  Jj? ( 1  -  xr)  V 

Ha  '  (t.v)  g  +  J7J^npl\ 


(56) 


(57) 


(58) 


92 


RADC-TDR-63- 147 


If  y/  =.  0  ,  then  »  >„ 

P 


and  (58)  reduces  to 

At  +  ~r(f~  r  )v' 

T 


v=o 


-^-(t-ir)in-  (/  - 


Hoe 

where 

y, 4 


(59) 


K  /  +  £** (1-  ir)v/*t 


(60) 


When  ^  30  (which  holds  for  most  cases  of  practical  interest), 


^  <  y< *60 ,  3*0  6  ^  and 

(t-v)ir/ & 


rr  <  t 
~6  4  "  /*,too 


1+60 


so  that 


r*A/''S  ,  jrl  (j-vf  jr^rjSg_  .JLr  (hQL 

S  -  ,z  *1  3  /2  /)/ 


/2 

and  (58)  and  (59)  reduce  to 

JP  _  _ Al/U-v) _ 

H~  -£+4-  4  e r 


Ho* 
Then 


'  *1  /Z 

/Z  1 


y-o 


7/  f-  z/"y 


A 


1  +  ir+ir 


(61) 

(62) 


+  -^-(/-r)2  +  sir 

Jt 


(63) 


Threshold  occurs  when  this  ratio  decreases  to  (  ),  ^  k®in|  a  ^ 

positive  number  much  smaller  than  1.  Thus,  at  threshold  ^  A<j 

so  that  A/  A  ~  /  and  threshold  occurs  when 


or 


A2.  / _ ^ 

1  +  IT1  H-  v y  <y*  i2 


(64) 
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Using  this  relation  together  with  (20),  which  expresses  in  terms 

of  J3  ,77?  and  6  ,  one  can  determine  J>r  ,  the  value  of  at 

threshold,  as  a  function  of  “7 77  and  6  by  trial  or  graphical  methods. 
We  note  that  (64)  woujd  be  exact,  if  TT  /  ir 

y  (*,)=[  '  ** 

L  o  £  IS  £  WHERE. 

instead  of  (53)  were  to  be  used  as  the  frequency  response  of  the  output 
filter. 


3.  Discussion  of 'Results 

The  main  purpose  of  this  investigation  is  to  investigate  the  behavior 
of  the  output  of  an  FM  receiver  in  response  to  a  stochastically  modu¬ 
lated  signal  in  the  threshold  region.  In  Figure  1,  the  decrease  in  the 
ratio  of  the  power  of  the  modulating  signal  to  the  mean  square  difference 
between  the  output  and  modulating  signal  below  that  predicted  by  the 
large  carrier-to-noise  power  ratio  theory  has  been  plotted.  For  the 
range  of  parameters  illustrated,  it  is  evident  that  the  deviation  is  neg¬ 
ligible  for  values  of  fi  ,  the  ratio  of  carrier  power  to  the  noise  power 
in  the  I.  F.  bandwidth,  greater  than  about  11  db,  and  that  the  threshold 
occurs  in  the  region  of  P  between  7  and  10  db.  Recalling  that  the 
I.  F.  bandwidth, 

Sie  =  ~{-we  +~) 

which  for  large  7r?  6  is  proportional  to  r/>  S  ,  one  notes  from  the 
figure  that  the  deviation  from  the  large  carrier-to-noise  power  ratio 
theory  -is  more  rapid  the  greater  the  I.  F.  bandwidth,  as  one  would  expect. 
The  apparently  gentler  behavior  of  the  yr\=  4  ,&  =  64  ,  0  delay  curve 
compared  to  the  4  ,  0*  64  ,  °o  delay  curve  is  explainable  as 
follow 8 .  Since  these  cases  both  have  the  same  I.  F.  bandwidth,  the 
discriminator  outputs  are  identical.  However,  the  zero  delay  Wiener 
filter  results  in  approximately  6  db  more  noise  output  power  than  the 
infinite  delay  Wiener  filter  above  threshold.  For  any  rate  of  occur¬ 
rence  of  impulses  (Nf  4-  A/-  times  per  second)  or  for  any  value  of 
V'  ,  the  relative  (db)  increase  in  noise  output  power  is  less  when  the 
zero  delay  filter  is  used  than  when  the  infinite  delay  filter  is  used*. 

On  the  absolute  basis,  the  infinite  delay  filter  will  always  give  superior 
performance.  This  phenomenon  is  more  clearly  demonstrated  by 
Figure  2  where  PjH  and  [p j 'h  are  plotted  against  the  channel 

quality  factor  A*  .  The  channel  quality  factor  AJ  may  be 


Because  the  ratio  of  the  noise  equivalent  bandwidth  of  the  zero  delay 
filter  to  that  of  the  infinite  delay  filter  is  less  than  6  db. 
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%  (=  6.02db) 


expressed  in  several  ways  in  terms  of  the  other  parameters  of  the 
system.  Thus, 


A'  = 


H 


CrSl 


2  ei  k2- 


f£_/z  (3 

TsfTJT  kz 


Ejjz  ez 
JlfkJI  z 


~  1/2  9 


where 


. .  .  .  modulation  parameter 


/>  = 


iL 4 

2  #  B,r 


.  .  .  .  carrier -to-noise  (in  I,  F.  bandwidth 
Bfp)  power  ratio 


D  k  _  _  ,  fe- 

-  -jfr  7r>6  +  — 


. .  .  .  I.  F.  bandwidth 


These  formulas  permit  ready  conversion  of  plots  ofiV H  versus 
against  other  parameters,  e.  g.  ,  to  convert  from  A0  db  to  I.  F.  carrier- 
to-noise  ratio, '  db  subtract  10  (jn  +  Tf/26^  03]  .  From  the 

first  expression  for  A*  ,  it  will  be  noted  that  ^  is  independent 
of  TV  ,  the  parameter  which  established  the  I.  F.  bandwidth,  and  hence 
for  fixed  modulation  (i.  e.  ,  for  fixed  [3  ,  £Z  and  k.  ),  the  channel 
quality  factor  is  proportional  to  the  ratio  of  carrier  power  to 

noise  power  density. 


97 


RADC-TDR-63-14? 


Figure  3  illustrates  performance  near  threshold  for  band-limited 
modulating  signals  with  two  different  power  spectrat  corresponding  to 
2T=  O  and  ir=  1  / 2  .  The  two  power  spectra  are  shown  in  the  insert 
of  the  figure.  It  might  be  mentioned  that  the  curves  shown  in  Figure  3 
are  practically  unchanged  if  a  sharp  cut-off  filter,  which  has  frequency 
response  _  _ . 

r,  **/*/*£  a 

yc{(s))—  ■ 

s.  or  else  mhere 

is  used  instead  of  the  Wiener  filter. 
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IV 


APPLICATION  OF  INFORMATION  THEORY  TO  BOUND  THE 
PERFORMANCE  OF  COMMUNICATIONS  SYSTEMS 


A  question  of  continuing  interest  is  to  what  extent  the  theorems  of 
information  theory  can  be  applied  in  order  to  establish  bounds  on  the  attainable 
performance  of  communications  systems.  Although  a  simple  or  complete 
answer  to  this  question  cannot  be  given,  some  preliminary  results  which  we 
have  obtained  are  presented.  In  the  process  of  doing  this,  we  also  hope  to  be 
able  to  dispel  some  widely  held  misconceptions. 

As  background  material,  we  will  very  briefly  review  some  of  the 
terminology,  theorems  and  results  of  information  theory.  The  proofs  of 
the  theorems  and  derivations  of  the  results  can  be  found  in  the  references 
which  are  given. 

We  shall  assume  that  all  processes  with  which  we  are  concerned  are 
ergodic.  *  The  most  important  properties  of  an  ergodic  process  for  our 
purposes  are:  that  any  sample  function  of  the  process  observed  over  a 
sufficiently  long  time  exhibits  a  behavior  typical  of  the  process,  and  that 
time  and  ensemble  statistics  are  identical.  In  the  case  of  a  discrete  random 
process,  such  as  a  sequence  of  digital  data,  only  a  finite  number  N(T)  of 
sequences  having  duration  T  seconds  have  a  nonvanishing  probability.  The 
rate  of  generation  of  information  of  such  a  process  is  defined  as 

(1) 

T  -+■  oo  [ 

The  capacity  C  of  a  channel  is  defined  as  the  maximum  rate  of  transmission 
of  information  of  which  the  channel  is  capable.  The  fundamental  theorem  of 
information  theory  states**  that  it  is  possible  to  transmit  information  at  a 
rate  R  £  C  with  arbitrarily  small  probability  of  error,  but  that  this  is  im¬ 
possible  if  R  >  C  .  In  order  to  achieve  rates  very  close  to  channel  capacity, 
very  lengthy  codes  (the  explicit  construction  of  which  is  not  known  in  general) 
may  have  to  be  used.  The  fundamental  theorem  applies  to  continuous  as  well 
as  to  discrete  channels. 


*  The  properties  of  an  ergodic  process  are  discussed  in  Reference  1 
(pp.  15,  57)  and  Reference  2  (pp.  67-68). 

**  Reference  1  (pp.  39,  67) 
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Consider  a  channel  in  which  the  transmitted  signal  X  is  perturbed  by 
an  additive  noise  n  so  that  the  channel  output  y  is  given  by  y  =  X  *  n  . 
Further,  let  the  bandwidth  of  this  channel  be  restricted  to  W  cps  and  the 
mean  square  value  of  the  input  =  P 

is  bounded  by 

Win,  ~jr~L  <  C 

N, 

where  N  =  average  power  of  the  noise 

=  entropy  power  of  the  noise 

The  entropy  power  A//  of  a  random  process  is  a  measure  of  the  random¬ 
ness  of  the  process.  White  gaussian  noise  has  the  greatest  entropy  (randomness) 
for  a  given  power  and  bandwidth  of  all  random  processes.  Entropy  power  of 
any  process  is  defined  as  the  power  of  a  white  gaussian  noise  having  the  same 
bandwidth  and  entropy  as  the  process  under  consideration.  Therefore,  we 
find  that  for  white  gaussian  noise,  the  entropy  power  N/  is  equal  to  the 
actual  power  N  and  for  any  other  process,  the  entropy  power  is  less  than 
the  actual  power.  If  the  additive  noise  is  white  and  gaussian,  the  upper  and 
lower  bounds  in  Equation  (2)  are  identical  so  that 

C  -  M/A  (t  +  jr)  (3) 

which  is  without  a  doubt  the  best  known  equation  of  information  theory. 


.  Then  the  capacity  of  the  channel 


Wlm. 


P+N 

N, 


(2) 


In  analog  communications  systems,  one  is  interested  in  reproducing  a 
continuous  waveform  presented  to  the  input  of  the  system  at  the  output.  Since 
a  continuously  variable  waveform  can  take  on  an  infinite  number  of  values, 
its  exact  transmission  would  require  a  channel  of  infinite  capacity.  In  practice, 
one  is  not  interested  in  reconstructing  a  continuously  varying  waveform  exactly, 
but  may  instead  decide  that  the  communication  system  is  satisfactory,  provided 
that  the  mean  square  error  between  output  and  input  does  not  exceed  some 
specified  value,  say  .  A ^  may  therefore  be  called  a  mean  square  error 

fidelity  criterion.  Satisfactory  communication  can  then  be  obtained  by  trans¬ 
mitting  instead  of  the  actual  waveform  produced  by  the  source,  one  of  a  number 
N(T)  of  preselected  sample  functions  of  duration  T  .  •  the  sample  functions 
being  selected  so  that  the  mean  square  difference  between  the  sample  function 
and  the  actual  waveform  is  less  than  N&  .  The  rate  of  generation  of  infor¬ 
mation  is  then  given  by 


R 


r-+  co  T 


(4) 


*  Reference  1  (p.  68) 
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where  N(t)  is  the  minimum  number  of  sample  functions  required  to  satisfy 
the  fidelity  criterion  .  This  rate  is  bound  by* 


where 


Ws  £*>.  ~j-  <  R  £  h/$  ~ 

P  -  power  of  the  source 
Pi  -  entropy  power  of  the  source 
Nc  -  permissible  mean  square  error 
Ws  =  bandwidth  of  source 


(5) 


By  the  fundamental  theorem  of  information  theory,  it  is  then  possible  to 
transmit  continuous  information  over  a  channel  of  capacity  C  with  a  mean 
square  error  not  exceeding  provided  that  C  £  R  where  R  is  given  by 
Equation  (5).  If  the  source  has  the  statistics  of  a  white  gaussian  noise  process 
then  the  upper  and  lower  bounds  of  Equation  (5)  are  identical  and 

R  -  Ws  (6) 

Suppose  now  that  the  communications  channel  has  a  bandwidth  WCH  ,  signal 
power  PCH  and  is  perturbed  by  additive  white  gaussian  noise  of  intensity 
N0  watts/cps.  The  capacity  of  this  channel  is  then 

CCH  "  WCH  4*  (l+  N'„ch  )  (?) 


The  information  rate  R  which  can  be  transmitted  over  this  channel  is  then 

R  *  CCH  (8) 

Substituting  Equations  (6),  (7),  we  find 

<»> 

p 

which  may  be  solved  for  -rj—  to  yield 

'V 


*  Reference  1  (p.  80) 
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with  n 


P_ 


('* 

0 * 


?CH 

N0WS 

■  PCH  . 

N0WS 

PCH 


Ms 

*CH 


J-SM. 


J  VS 


dim 

n-*°° 


Wen 

Ms 


JL  <  -N0*S 

He  -  * 

bandwidth  expansion  factor. 


(10) 


It  should  be  carefully  born  in  mind  that  Equation  (10)  applies  only  to  the  case 
where  the  source  has  the  statistics  of  a  white  gaussian  noise  (since  we  assumed 
Pf  =  P  )  and  that  N is  defined  as  the  mean  square  error  between  the 
output  and  input  waveforms. 


then 


If  the  input  source  does  not  have  the  statistics  of  white  gaussian  noise. 


P  <  Ws  dn.  7£r 


Satisfactory  transmission  requires  C  >  R  so  that 


Ws  >  R  <  C 


WCh4»  (t+  H0WCh  ) 


(11) 


(12) 


*  ( i  + ...  pw  -L)n 

*  (  N0WS  n  / 


From  (12)  it  is  clear  that  this  approach  will  not  yield  a  generally  valid  bound 
on  the  maximum  value  of  P/H£  which  cam  be  obtained  by  use  of  a  given  channel.  * 
On  the  other  hand,  using  the  lower  bound  of  Equations  (5)  and  (8),  we  find 


Ws  dn  -Q-  <  R  <  C 
Nc 


WCn  0 


j£4L 


Ho  WCn 


-) 


A.  <  -L)" 

H£  V  N0  Ws  n  J 


(13) 


dim 

n-+oo 


_2_ 


PtH 


Equation  (13)  is  a  valid  bound  for  the  maximum  attainable  ratio  of  source 
entropy  power  to  mean  square  error  between  the  output  and  input  of  a  system 
containing  a  channel  perturbed  by  additive  white  gaussian  noise.  Equation  (13) 
is  plotted  in  Figure  1  with  n  as  a  parameter. 


*  Numerous  attempts  at  deriving  an  expression  for  the  maximum  attainable 
signal-to-noise  ratio  at  the  output  of  a  communications  system  are  recorded 
in  the  literature,  References  3,  4,  5. 
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In  connection  with  Figure  1,  it  is  again  emphasized  that  signal  power 
and  signal  entropy  power  are  equal  only  if  the  signal  has  the  statistics  of 
white  gaussian  noise. 

In  order  to  gain  a  better  understanding  regarding  the  relationship  of  the 
above  bounds  to  the  performance  of  practical  communications  systems,  let 
us  re-examine  the  manner  in  which  the  bounds  were  derived.  The  central 
idea  used  in  the  derivation  was  that  of  coding  which  would  involve  a  delay  at 
both  the  transmitter  and  the  receiving  terminals.  At  the  transmitter,  an 
entire  sample  of  duration  T  is  obtained  from  the  random  source  and,  then, 
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the  closest  of  the  N(T)  sample  functions  is  selected.  A  code  word  repre¬ 
senting  this  sample  function  is  then  transmitted*,  perturbed  by  noise,  decoded, 
and  the  waveform  corresponding  to  the  code  word  reproduced  at  the  receiver. 

If  the  channel  signal-to-noise  ratio  is  improved  and  the  same  code  used,  the 
mean  square  error  of  the  output  remains  unchanged.  (Actually,  only  the 
probability  of  error,  which  is  already  assumed  arbitrarily  small,  decreases.  ) 
These  characteristics  are  in  sharp  contrast  with  those  of  communications 
systems  using  modulators  and  demodulators  which  have  essentially  zero  delay. 


*  Note  that  the  characteristics  of  the  coded  message  need  not  be  simply 
related  to  the  original  waveform;  they  are,  in  fact,  determined  by  the 
characteristics  of  the  channel. 
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V 


TRANSMISSION  OF  ANALOG  INFORMATION 
OVER  A  DIGITAL  CHANNEL 


INTRODUCTION 

The  transmission  of  analog  data  by  means  of  a  digital  data  link  is  a 
practical  technique  whereby  a  desired  output  signal-to-noise  ratio  can  be 
obtained  with  reduction  of  transmitted  power  but  at  the  expense  of  increased 
channel  bandwidth.  Furthermore,  the  digital  system  is  adaptable  to  a 
variety  of  digital  coding  schemes  which  have  been  developed  for  purposes  of 
security  or  antijam  protection.  In  this  chapter  some  of  the  characteristics 
and  limitations  of  such  systems  will  be  investigated  and  compared  with 
recent  work  by  D.  Slepian1’2  which  establishes  bounds  on  the  error  rate 
performance  of  the  digital  link. 

Commonly,  analog  transmission  systems  are  compared  on  the  basis 
of  the  output  signal -to -noise  ratio  attainable  with  a  specified  channel  signal- 
to -noise  ratio,  while  digital  systems  are  generally  analyzed  in  terms  of  the 
probability  of  error  as  a  function  of  the  channel  signal-to-noise  ratio.  In 
comparing  discrete  and  continuous  systems,  or  in  evaluating  the  performance 
of  analog-digital-analog  systems,  it  is  desirable  to  establish  a  relationship 
between  an  equivalent  analog  signal-to-noise  ratio  and  the  corresponding 
error  (quantization  error  and  errors  due  to  noise)  of  the  digital  channel. 

In  Chapter  IV,  it  was  pointed  out  that,  in  general,  it  is  not  possible 
to  apply  the  theorems  of  information  theory  in  order  to  establish  performance 
bounds  of  analog  communications  systems  in  terms  of  the  channel  and  out¬ 
put  signal-to-noise  ratios.  However,  when  a  specific  digital  system  is 
employed  for  the  transmission  of  analog  data,  such  relationships  may  be 
developed  which  are  useful  in  comparing  the  performance  of  the  various 
systems. 

First,  it  is  necessary  to  establish  a  reasonable  definition  of  "signal- 
to-noise  ratio".  Although  we  have  not  been  able  to  obtain  a  universally 
applicable  definition,  the  one  adopted  below  is  reasonable  for  the  systems 
under  consideration  and  is  also  consistent  with  the  signal-to-noise  ratio 
properties  that  one  normally  would  require  for  the  linear  system  shown  in 
Figure  1. 

In  this  linear  system  in  which  independent  noise  is  added  to  the  input 
signal,  one  certainly  expects  the  signal-to-noise  ratio  at  both  the  input 
and  output  of  the  linear  amplifier  of  gain  K  to  be  S/N  •  where 
is  the  input  signal  power,  and  V  ■  </?*>  is  the  additive  noise  power.  Note 
that  by  requiring  the  output  signal-to-noise  ratio  to  be  independent  of  the 
linear  gain,  we  rule  out  defining  S/N  as  the  ratio 

signal  power  of  input  signal  . 

mean  square  dilference  between  output  and  input 
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INPUT  TC 
<X3>«S 


n 

<nl>*  N 


OUTPUT  1, 
<?)*(S+N)K2 


FIGURE  1 


In  the  linear  case,  we  could  get  the  desired  result  by  taking  the  ratio  of 

output  power  due  to  signal  only  . 
output  power  due  to  noise  only 


However,  such  a  definition  fails  when  there  are  nonlinear  devices  in  the 
system  and  also  gives  unreasonable  results  when  a  linear  filter  is  interposed 
into  the  system.  We  have  chosen  to  define  the  output  S/N  as 

portion  of  output  correlated  with  input 
portion  of  output  uncorrelated  with  input 


which  appears  to  have  a  greater  range  of  applicability  and,  also,  gives  the 
desired  result  for  the  system  shown  in  Figure  1.  Thus, 


_5 

N 


U) 


where  the  correlation  coefficient  p  is  defined  by 

>  <**>* 


(2) 


Now,  consider  the  system  shown  in  Figure  2. 


ad) 


H 


WN)o 


FIGURE  2 
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Let  ait)  be  a  random  function  of  time  which  has  zero  mean  and  is 
limited  to  a  bandwidth  Wo  .  By  the  sampling  theorem,  ait)  is  completely 
determined  by  samples  a.„  taken  once  every  ^  seconds.  Let  the 
samples  be  independent  and  uniformly  distributed  over  the  range  t 
From  each  sample,  one  of  M  quantized  samples,  ,  is  generated  as 
follows:  If  »i-f  ,  then 

*“*(**■  T^)*  J  =0*1*2-"'  M~l  (3) 

Each  X;  is  transmitted  over  a  digital  channel  and  received  as  ,  with 
a  probability  /#{)  The  sample  is  given  by 

Vk  mA(k~*y-)i  4  ■  0,1,2,— ,  M-l  (4) 

Since  ait)  is  sampled  at  intervals  of  Jj(£~  seconds,  the  samples  ^  occur 
at  this  same  rate.  They  are  passed  through  an  ideal,  unity  gain  low-pass 
filter  with  bandwidth  Wo  cps ,  and  the  system  output  j,(t)  is  formed.  *  Note 
that  the  analog  input  to  the  system  is  aji)  and  the  analog  output  is  j. it )  ; 

however,  they  are  completely  determined  by  the  samples  aMa  Cb(  *••$%) 
and  fo)  -  yit»  fa)  m  ,  respectively.  Figure  3  shows  the  rela¬ 

tionship  between,  ana  the  range  of  the  variables  in  the  system  of  Figure  2. 


The  performance  of  the  system  for  transmitting  analog  information, 
described  above,  will  now  be  obtained  in  terms  of  the  error  rate  performance 
of  the  digital  channel.  First,  a  conventional  binary  PCM  system  using  an 


-• O 


slnnizwat-n) 
rri2W,t  -n) 


fn  *,nc  *•> 
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optimum  bipolar  binary  keying  technique  will  be  investigated.  Then  the 
performance  of  a  similar  binary  PCM  system  will  be  evaluated  under  the 
assumption  that  the  transmitted  digits  are  scrambled  so  as  to  produce  a 
uniform  distribution  of  the  errors  among  the  incorrect  levels.  Finally, 
these  results  will  be  compared  with  performance  curves  developed  from 
the  recent  work  of  Slepian  which  established  performance  bounds  (proba¬ 
bility  of  error)  on  digital  systems  operating  over  a  noisy  channel. 


Since  we  are  concerned  with  an  analog  communication  system,  the 
system  performance  will  be  described  by  the  relationship  between  the  output 
signal-to-noise  ratio  (S/N)0  and  the  channel  signal-to -noise  power  ratio. 


Then,  from  Equation  (1) 


where 


P 

1~P 


&  frjf* 


or  in  terms  of 


-  y* 


p 


W><vt> 


(5) 

(7) 

(7) 


THE  PCM  CHANNEL 

Consider  a  PCM  channel  where  an  rt  -bit  number  represents  each 
of  M  -  2n  quantized  levels  to  be  transmitted.  Since  a  sample  is  formed 
every  seconds,  the  number  of  bits  generated  per  second  is  ZlV^n 

Assuming  bipolar  keying,  each  bit  is  received  with  a  probability  of  error 
per  bit,  q  ,  given  by3 

where  E  is  the  energy  per  bit  and  A/0  is  the  noise  power  density.  Since 
the  transmitted  power  $  is  equal  to  ZW0r\E  > 

where  (S/N)[  is  the  channel  signal-to-noise  ratio  with  the  noise  referred  to 


Since 


&(*)  •  2]  Q>n  and 


oo 

3inc  -6j  sine  aii 


Jm* 

j*k 
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a  bandwidth  W0  .  In  bipolar  keying,  two  bits  may  be  transmitted  per  cycle 
of  output  bandwidth;  therefore,  we  obtain  n  •  W/l%  ,  the  bandwidth  expan¬ 
sion  factor. 


per  bit 


We  now  proceed  to  find  jo  in  terms  of  ^  ,  the  probability  of  error 


1  rfL V*  1  a  3 

—  /  a1  dou  mJLSba. 
^  MAl**  n  MA  3 


-r 


M*Al 

/E 


1 


Since  CL^  is  uniformly  distributed,  jo(x>i)*  —  ,  therefore 

M-t  .a  M-/ 

ZX-sZt 

i*0  i*0  '  ~  ixQ 


t  V-/ 


MIq,  2 


] 


(10) 


/2 


(id 


M-t  M-1 


M-f  M-t 


<y?>  -EE  p(v*l*i )  /*<*$  y*  *  &  Z  |T  />  /*.• )  y** 

/•O  Ar«0  7*0 


(12) 


Since  the  bit  errors  are  independent  in  binary  coding 

p(tfk\*i)*0-<?)r‘k  q(n  ^  p(tfilXk) 

where  is  the  number  of  correct  transitions. 
Therefore,  m-i  M-t 

mZII 

k*o 


M 

where  use  is  made  of  (3),  (4)  and  (11). 


M  tJo  ,c 


(13) 


(14) 
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To  obtain  (a„  yk  ^  ,  we  first  obtain  (a,n  which  is  the  expected 

value  of  Q>nyn  given  that  j£>i  was  sent. 


*i  +  T  M-t 


<Pn  «/*>,'  m  f  II  Vkp  Vk  l*i  ) 


*•<> 

*  2 


(15) 


Since  *,•  is  being  sent,  p  (y.  jx-,% )  =  p(  yjxt-)  and 

therefore 


Uk>t m  J  IZ  antk  ?(</*  l  Pi)  P  (*n  I  Pi  )  cUPn 
"  [£  !/kP  (^lKi  >]  [/  A  *nP(' an\Pi  )^n] 


(16) 


Before  summing  on  x>-t  to  obtain  ,  we  must  evaluate 

The  binary  number  i  representing  may  be  written  as 


n-t 

‘-£  £^0,2^  where  oL^  is  either  1  or  0  (17) 

<.zO 


Using  Equation  (4),  we  may  write 

<18> 

Let  -  0  or  1  and  <4*,*  =  0  or  1  be  the  4/th  bit  of  the  n  -bit  code 

representing  k  and  £  ,  respectively.  Then 


n-t 


k~L  =  ZZ  &+.k  2‘ 

As  O 

(.k  -i)j  —  ^  ^o^A.k  -^4,^1  2 


Af*0 


(19) 
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Since  ~  d^‘t  >  -  [iff -f)  x  +  [f*  f\  -f  given  d^t  -  0 

and  <d^k  -  <2^;>  -  [(f-f)  <  O]  +  [?*(-/]  given  d^  -  / 


we  can  write  <<4  *  «  (f  ~  i ) $ 

Therefore  f 

4*zO  4**0  4»«0 

<*-*>;  =  ?<V-/>  -2?. 

But  <*-/>,.  =  <*>/  "/ 

Therefore  <f/c>;  *  i+ f(M-1)  -  2fi 


(21) 

(22) 


From  (18)  and  (22),  we  obtain 

<!<A'  "  -  ^f1}  *  *  {l+l(M-t)  -Zfi-  t!zLj 

■'{(‘-W-'fO-W} 

where  use  is  made  of  Equation  (3). 

Using  (16)  and  (23) 

<«*  y*>i  *  <</*>«  -  **(1-2%) 

Therefore  <a„y*>  -  (l - Zq) 
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We  may  now  obtain 
and  (24) 

P*  = 


p  for  PCM  by  combining  (7),  (10),  (11),  (14) 


tz 

~M‘A 


Using  the  definition  for  (S/N)0  .  we  obtain 

/_S_\  PZ  _  (M*-t)(1-29)L 

U  /*/"/ 


-/oz  "  hAt-(M2-1)(1- Zq)1 


(25) 


(26) 


Using  Equation  (9)  for  bipolar  keying 

Therefore,  for  binary  PCM  using  bipolar  keying,  we  get 

(±\  _  (/v/Z- 
N  «  **’(**- 


(27) 


(28) 


Equation  (28)  is  plotted  in  Figure  4  for  n  =  5,  7,  10  and  13. 


A  MODIFIED  BINARY  PCM  SYSTEM 

It  is  of  interest  to  obtain  the  performance  of  a  binary  PCM  system 
where  the  errors  are  distributed  uniformly*.  To  do  this,  we  obtain 
the  probability  of  error  in  transmitting  an  n-bit  character  using  PCM  with 
bipolar  keying 


(29) 


Equal  probability  of  all  errors  can  be  assured  by  making  the  assignment 
of  the  sampled  values  ,  to  the  transmitted  characters,  at  random  (of 
course,  the  assignments  must  be  made  in  unison  at  the  transmitter  and 
the  receiver). 
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Figure  H  CONVENTIONAL  BINARY  PCM 
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Knowing  f  ,  as  given  by  Equation  (9),  we  may  plot  Qp  vs.  channel  signal- 
to-noise  ratio  £(S/M)‘,  (Figure  5).  Given  the  character  error  Qp  and  the 
assumed  distribution,  we  may  write,  paralleling  the  approach  used  for 
normal  binary  PCM, 


<a,n*> 


M*Al 


<*if> 


U-1  U-f 


<V >  -  If  II E  p(<jki*i)ynt 

m  i*0  kmO 

kmO  1*0 

Since,  when  an  error  is  made,  it  is  assumed  to  be  equally  distributed 

P((/k\*i)  -  p(</i\*k) 


‘dk  -  <*\>  -  -jzCm'-i) 

m k*0 


As  in  conventional  PCM  from  Equation  (16) 
<an  Vk  >i  -  *i<Vk>i 

In  this  case, 


<yk>i  m  y* 

kk°t 

_  _ ...  _  / 


Since 


Then 


Vi  e 


<*»**>;  -  **'(' -SpxTryj 

<<W  -  ( !~Qr £r)<*t> 


Therefore,  from  Equations  (7),  (30),  (31),  (34)  and  (37) 

^  _  ..<?»&>*  _  „  M  \l 


2.  _  M  \*  *fl- 
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Figure  5 
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(39) 


From  the  definition  of  (S/Af)0  ,  we  obtain 

/5\  _  QpTTl)2 

The  probability  of  character  error.  Op  ,  versus  the  channel  signal-to- 
noise  ratio ,^(S/N)i  has  been  computed  for  binary  PCM  and  is  plotted  in 
Figure  5.  Using  Equation  (39)  for  the  modified  binary  PCM  system  and 
the  Op  curves  of  Figure  5,  the  output  signal-to-noise  ratio  (S/fJ)0  has  been 
plotted  versus  (S/V)/  in  Figure  6  for  values  of  n  =  5,  7,  10  and  13. 

COMPARISON  WITH  BOUNDS  ON  DIGITAL  SYSTEMS 

i  o 

D.  Slepian ,  in  two  recent  papers  *  ,  has  applied  some  of  Shannon's 
results  to  obtain  a  bound  on  the  error  probability  in  the  transmission  of 
digital  data  over  a  noisy  channel.  Slepian  presents  curves  which  give  the 
minimum  channel  signal-to-noise  ratio  required  to  obtain  a  given  proba¬ 
bility  of  error,  Q  ,  for  various  values  of  n  and  RjW  ,  where  n  is  equal 
to  2WT{  IV  =  channel  bandwidth  and  7*  is  the  coding  delay)  and  R/W  is 
the  information  rate  per  unit  of  transmitted  bandwidth. 


(40) 


(41) 

Since  Q,  is  the  probability  of  error  in  the  transmission  of  a  code  word  T 
seconds  long,  it  is  equal  (in  the  PCM  system  where  T  =  )  to  the 

probability  of  error  in  the  transmission  of  jt;  .  0 

Figure  5,  obtained  from  cross  plots  of  data  presented  in  Reference 
2,  shows  curves  for  Q  versus  £(S/R)[  for  various  values  of  n  • 

In  order  to  obtain  an  output  signal-to-noise  ratio  from  these  curves, 
we  make  the  assumption  that  when  an  error  is  made,  it  is  uniformly  dis¬ 
tributed  among  M-l  levels.  (As  was  previously  noted,  this  assumption 
may  always  be  satisfied.  )  This  allows  us  to  use  the  intermediate  results 
obtained  in  Equation  (39)  for  the  modified  binary  PCM  system. 


In  the  case  of  PCM,  the  delay  time,  T  ,  is  equal  to  the  sampling 
period  and,  hence, 

n  -  ZWT 


_  w 

zw0  “  w: 


Then, 


-  2W 

R  2W0  .  .. 

~w  ~  ~W~  lc*'° M 

=  0.6 
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(*/«),.  db 


Figure  6  MODIFIED  BINARY  PCM  (WITH  UNIFORM  ERROR  DISTRIBUTION) 
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Hence, 


,s\  u 

'N'o  M* -(Mt-1)(j-Q.~fi7j y 


(42) 


Equation  (42)  relates  the  output  signal-to-noise  ratio  to  the  proba¬ 
bility  of  a  character  error  Q  Using  the  Q  curves  of  Figure  5  and  Equa¬ 
tion  (42),  the  output  signal-to-noise  ratio  versus  channel  signal-to-noise 
ratio  (S/N )•  has  been  plotted  in  Figure  7. 


CALCULATION  OF  RATIO  OF  SOURCE  ENTROPY  POWER  TO  MSE 

In  Chapter  IV  of  this  report,  bounds  on  the  maximum  attainable 
ratio  of  source  entropy  power  p1  to  mean  square  error  (MSE)  have  been 
presented.  This  ratio  may  be  obtained  for  the  systems  under  consideration 
in  this  chapter  and  compared  with  the  results  shown  in  Figure  1  of  Chapter 
IV.  The  entropy  power  of  the  source  is  defined  by 

„  1 '  „tn' 


2rr  e 


where  H;  is  the  entropy  per  degree  of  freedom  of  the  source.  Since  the 
samples  of  the  source  are  independent, 


with 


Then 


P(*n)  = 


AM  , 


MA 


anl  <  2 

0  ,  elsewhere 

MA 


n  +  A"* 

H>  m  l " ln  jh 

and  combining  (43)  and  (46), 


p  m  1  g  ln(MA)  m  (MA) 


Since 


and 


<<*»> 


MZA‘ 

12 


2rre 
(from  (10)  ) 


2rre 


Pi  mm«>  =  0.70*  <&n*) 


J-L-  m  0.  70S  <^°'n  ^ 
MSE  '  MSE 


(43) 


(44) 


(45) 


(46) 


(47) 


(48) 


(49) 
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Figure  7  PCM  PERFORMANCE  BASED  ON  DI6ITAL  BOUNDS  FROM  REFERENCE  2 
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In  order  to  minimize  the  MSE,  y^  is  modified  by  a  gain  factor  X  • 


MSE  =  <(*„  »  W>  +  *'<* k>  ~  **<*„«/*>  (50) 

From  (24)  and  (37)  and  since  *  K.t>i 

MSE  -  <a„4>  +  -  2  <*{.!>  (51) 

where  <f>  =  (f-  2?)  for  conventional  binary  PCM  with  bit  error  rate  y. 

and  <p  =  (  1-Qp  ~M—\  for  PCM  with  a  uniform  character  error 
M~* '  distribution. 


To  minimize  the  MSE  with  respect  to  X  . 


g^MSE)  -  -zf><*izy  -  O 

from  which  A  *  ^ 

Therefore,  the  minimum  MSE  is  given  by 

MSE  *  <ah2(>  + 


Then 


<ro-w*> 


^  ^ -  m 

mse  <*„>>- 

From  (10),  (11),  (30)  and  (31) 


and,  therefore. 


<£l2_. 

<«**> 

<Q  . 

MSE 


M 


Md 


£ 


'-&*1 


For  the  case  of  conventional  binary  PCM, 


s_  = 


0.703 


MS£r  f- ■*&*■('-*&* 

A7 

and  for  modified  binary  PCM  (uniformly  distributed  errors) 


a. 


0.703 


/t/Jf 


/-  ML-tfj-Q . AL  4 2 


(52) 


(53) 


(54) 


(55) 
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and  for  the  PCM  system  based  on  the  error  rate  bounds  given  in  Figure  4 
(Q  curves) 


P,  0.703 _ 

*** ' 

Equations  (55)  and  (56)  are  plotted  in  Figure  9  for  n  -  5  and  n  -  10 
( M  ~  32  and  1024)  along  with  the  bounds  obtained  in  Chapter  IV. 


(56) 


SUMMARY  AND  DISCUSSION  OF  RESULTS 

The  application  of  PCM  techniques  to  the  transmission  of  continuous 
data  has  been  investigated.  Equation  (28)  relates  the  output  signal -to -noise 
ratio  for  conventional  binary  PCM  to  the  number  of  quantization  levels 
and  the  channel  signal-to-noise  ratio.  These  results  are  plotted  in  Figure  4 
for  various  bandwidth -expansion  factors. 

Figure  6  is  a  similar  plot  in  which  the  output  signal-to-noise  ratio 
is  plotted  as  a  function  of  the  channel  signal-to-noise  ratio  for  various 
values  of  n  when  the  binary  PCM  system  is  modified  such  that  the  errors 
are  uniformly  distributed  among  the  incorrect  levels. 

Then,  from  Equation  (42)  and  using  the  bounds  on  the  error  proba¬ 
bility  as  given  by  the  Q  curves  in  Figure  5,  we  obtain  a  bound  on  the  output 
signal-to-noise  ratio  as  a  function  of  channel  signal-to-noise  ratio  for 
difference  values  of  n  .  This  represents  an  upper  bound  (but  not  necessarily 
the  lowest  upper  bound)  on  the  performance  of  the  modified  PCM  system 
with  a  uniform  error  distribution  and  these  results  are  plotted  in  Figure  7. 

For  purposes  of  comparing  different  communication  techniques,  it 
is  desirable  to  exhibit  the  performance  characteristics  of  these  systems 
by  a  curve  representing  the  envelope  of  the  knees  of  the  curves  in  Figures 
4,  6  and  7.  Such  curves  for  the  two  PCM  systems  are  shown  in  Figure  8 
as  curves  C  and  D  and  give,  for  a  particular  desired  output  signal-to-noise 
ratio,  the  minimum  channel  signal-to-noise  ratio  required.  Similarly, 
curve  B  in  Figure  8  is  the  envelope  of  the  knees  of  the  curves  given  in 
Figure  7,  based  on  Slepian' s  work. 

In  the  system  shown  in  Figure  2,  the  information  signal  is  converted 
into  a  discrete  signal  source  of  M  levels.  Since  one  sample  is  obtained 
every  seconds,  the  maximum  information  rate  of  this  source  is  given 

by 


R0  «  2Wcl0f2M  bits/sec.  (57) 

Note  that  R  may  be  less  than  if  the  sample  values  are  correlated  or 
if  the  M  levels  are  not  equally  likely.  Shannon  has  shown  that  it  is 
possible  to  transmit  a  message  with  an  arbitrarily  small  error  probability 
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over  a  channel  of  bandwidth  W  perturbed  by  additive  white  gaussian  noise 
of  average  power  N  and  with  average  message  power  S,  provided 

R<Wlo9i(l-hff).  (58) 

Letting 

R0  *  2W0lo9z  M  -  Wlosz(l+%)  (59) 


we  can  find  the  minimum  S/N  required  to  reproduce  the  M  level  signal 
with  a  probability  of  error  as  small  as  desired.  With  reference  to  the  system 
of  Figure  2,  a  zero  error  probability  will  result  in  an  output  (S/N)0*  p 
given  by  Equation  (26) 

($/N)0  -  M*-f  (60) 


Solving  for  M  and  substituting  in  Equation  (59)  we  obtain 


% 


Solving  for  (S/fi/)c 


("l  '  nf- 


(61) 


(62) 


Equation  (62)  is  also  plotted  (Curve  A)  in  Figure  8  and  relates,  for  a 
desired  (S/N)c  (and  a  given  bandwidth  expansion  factor),  the  minimum  value 
of  (S/N)l  required.  It  should  be  emphasized  that  this  minimum  (S/b/)g  is 
achieved  only  with  a  sufficiently  long  and  complex  encoding  process  which 
entails  a  delay  approaching  infinity  while  the  (Other  curves  represent  systems 
in  which  the  delay  is  equal  to  • 


Curve  B  represents  a  bound  on  the  performance  of  a  system  with  a 
uniform  error  distribution  and  having  the  same  number  of  degrees  of  freedom 
as  a  binary  PCM  system  (R/W  -  0.  6)  and,  therefore,  may  be  compared  to 
the  modified  PCM  system  (Curve  D).  We  note,  again,  that  Curve  B  is  an 
upper  bound  but  not  necessarily  the  lowest  upper  bound  and,  hence,  does 
not  indicate  that  a  system  exists  which  can  do  as  well.  However,  we  see 
that  only  a  few  db  of  (S/N);  separate  this  upper  bound  fr.om  the  modified  PCM 
system  represented  by  Curve  D.  The  output  signal-to-noise  ratio  in  these 
PCM  systems  is  found  to  be  a  function  of  the  manner  in  which  the  errors 
are  distributed  among  the  incorrect  levels,  as  is  demonstrated  in  Figures 
4  and  6.  It  is  observed  that  the  difference  in  the  error  distribution  has 
its  greatest  effect  at  very  low  signal-to-noise  ratios  and  has  relatively 
less  effect  on  the  position  of  the  knees  of  the  curves.  As  would  be 
expected,  for  the  PCM  systems  considered,  the  signal-to-noise  ratio 
performance  is  degraded  by  imposing  the  condition  of  uniform  error 
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distribution  as  compared  to  the  conventional  binary  PCM  system  where  the 
error  distribution  is  more  favorable. 

The  performance  bounds  developed  by  Slepain  in  Reference  2  allow 
one  to  establish  bounds  on  the  performance  of  various  systems  consider¬ 
ably  more  complex  than  the  binary  PCM  systems  considered  here.  One 
might  consider  coding  schemes  in  which  a  coding  and  a  decoding  delay,  T  , 
is  accepted  (where  T>  )  but  where  the  information  rate  to  channel 
bandwidth  ratio  remains  unchanged.  Thus,  n  -  ZWT  has  been  increased 
and,  from  Reference  2,  we  can  establish  bounds  on  the  performance  of 
these  systems.  It  should  be  noted  that  Reference  2  provides  not  only  a 
performance  bound  that  cannot  be  exceeded,  but  also  provides  curves 
which  define  a  performance  level  that  is,  at  least,  obtainable.  It  should 
also  be  noted  that  when  a  code  group  is  decoded,  not  all  of  the  data  words 
will  necessarily  be  incorrect.  The  distribution  of  these  data  word  errors 
is  not  specified  in  Reference  2  and  would  have  to  be  known  from  the  char¬ 
acteristics  of  the  given  coding  system  in  order  to  compute  the  system  output 
signal-to-noise  ratio.  However,  if  the  resulting  error  probability,  <Q  , 
is  sufficiently  small,  the  only  contribution  to  the  output  noise  will  be  due  to 
quantization  noise,  and  the  limiting  output  signal-to-noise  ratio  may  be 
obtained  from  the  expression  given  by  Equation  (62). 

In  Chapter  IV,  bounds  on  the  maximum  attainable  ratio  of  signal 
entropy  power  to  mean  square  error  were  derived  and  plotted  in  Figure  1 
of  that  chapter.  This  ratio  also  has  been  computed  for  the  PCM  systems 
considered  in  this  chapter,  and  some  of  these  results  are  plotted  in  Figure 
9  along  with  the  results  from  the  previous  chapter.  The  Pt/Mse  for  the 
modified  PCM  (uniform  error  distribution)  is  plotted  from  Equation  (55) 
for  ft  -  5  and  t?  =  10,  and  the  for  the  PCM  system  based  on  the 

probability  of  error  bounds  of  Slepian  are  also  plotted  for  the  same  values 
of  /?  .  These  curves  are  very  similar  to  the  (S/N)0  curves  plotted  in 
Figures  6  and  7  and  show  the  threshold  of  the  modified  PCM  system  to 
fall  a  few  db  from  the  threshold  of  the  curves  developed  from  Slepian' s 
bounds.  However,  we  see  that  the  bounds  on  th e  obtained  from 

Chapter  IV  fall  several  db  to  the  left  of  the  PCM  curves,  which  reflects  the 
relatively  poor  utilization  of  the  theoretical  channel  capacity  by  a  binary 
signaling  system  for  this  range  of  channel  signal-to-noise  ratios.  It  may 
be  further  noted  that  the  bounds  obtained  in  Chapter  IV  apply  to  all 
signaling  schemes  whereas  Slepian' s  bounds  apply  only  to  equal  energy 
signaling  methods  and  that  binary  PCM  is  in  the  latter  class. 
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SOURCE  ENTROPY  POWER 


0  %  8  1  2  18  20  28  28 
(S/N)|,  CHANNEL  SI8NAL-TO-NOISE  RATIO,  8b 

Figure  9 
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VI 


APPLICATION  OF  A  PARTIAL  ORDERING  OF  CHANNELS 
TO  THE  COMPARISON  OF  DIGITAL  DATA  SYSTEMS 


The  problem  of  comparing  digital  systems  with  different  size 
transmission  alphabets  has  recently  been  considered  by  Wolf.  *  The 
method  of  comparing  N-ary  systems  described  by  Wolf  is  as  follows. 
A  K-ary  stream  of  information  digits  is  converted  to  an  N-ary  stream 
of  transmission  digits  and  the  received  N-ary  transmission  digits 
are  then  converted  back  to  a  stream  of  K-ary  digits.  The  probability 
of  error  per  K-ary  character  in  the  output  stream  is  denoted  by  P^. 
In  comparing  two  systems  having  transmission  alphabets  of  size  Nt 
and  A4  ,  if  pj  <  P**'1'1  ,  the  Nj-ary  system  is  more 

reliable  than  the  N2-ary  system  for  transmitting  K-ary  information. 

A  reversal  of  the  inequality  reverses  the  ordering  of  the  reliabilities 
of  the  systems. 


Wolf  illustrates  the  surprising  result  that  the  relative  performance 
of  the  systems  for  fixed  N,  and  Nz  may  depend  upon  the  size  A 
of  the  information  alphabet  for  which  the  error  probabilities  are  com¬ 
puted  and  then  compared.  Thus,  it  is  possible  that  <  P^l) 

for  a  comparison  on  the  basis  of  Kj  -ary  information  digits  while  for 


>  Pa 


Now,  for 


K2 -ary  digits  (A2  ^  A/) 

optimum  coherent  detection  of  N  orthogonal  signals  of  equal  energy 
E  ,  chosen  at  the  transmitter  with  equal  probability,  and  corrupted 
by  additive  white  gaussian  noise  with  zero  mean  and  spectral  density 


Na 


the  probability  of  error  per  N-ary  character  is 


p*  ~  J  ^  JtI*  ~ JW -) 


(i) 


where 


2 

If  A  =  2  and  A/  is  an  integral  power  of  2,  then 

(v)  N 


D  '  _ 

rz  ~ 


2(n rN 


(2) 


(3) 
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U) 


(32  ) 


By  reference  to  Figure  1,  one  sees  that  P^“'  <  for  low 

signal-to-noise  ratios,  that  is,  when  the  energy-per -information-bit/ 
noise -power -density  is  less  than  approximately  -^db.  However,  Wolf 
also  shows  that  in  this  same  range  P3Z  >  P3%2  ,  which 

illustrates  the  dependence  of  this  method  of  comparison  upon  the  size 
of  the  K-ary  comparison  alphabet.  A  dependence  upon  signal-to-noise 

ratio  is  also  evident  from  Figure  1  in  that  Pz*  >  - 

approximately  -5  db. 


above 


Thus  far,  only  digital  systems  characterized  by  square,  symmetric 
transition  probability  matrices  between  input  and  output  symbols  have 
been  discussed.  We  will  now  describe  a  basis  for  comparing  arbitrary 
discrete  communication  channels,  i.  e.  ,  systems  characterized  by  general 
rectangular  probability  matrices,  which  is  both  intuitively  satisfying 
and  contains  within  it  the  results  described  above.  This  comparison 
method  is  based  upon  the  partial  ordering  of  communication  channels 
which  was  introduced  by  Shannon^  and  extended  in  RADC-TDR-62-134. 

The  class  of  all  discrete  memoryless  channels  is  partially  ordered  with 


respect  to  a  relation  of  inclusion, 
and  K3  are  any  channels, 

written 

*  i.  e.  , 

if  K,  , 

(i) 

K,  2 

(ii)  If 

K,  s  Kl 

and 

*2 

2  K , 

,  then  K, 

It 

N 

(iii)  If 

K  /  —  Kz 

and 

Kz 

S*3 

,  then  A/ 

2  Ks 

The  inclusion  relation  itself  can  be  defined  in  terms  of  the  transition 
probability  matrices  which  pertain  between  channel  input  and  output 
symbols.  Keeping  in  mind  that  the  transition  probability  matrix  of  a 
cascade  of  channels  is  the  matrix  product  of  the  individual  channel 
transition  probability  matrices,  given  a  channel  represented  by  a  transi¬ 
tion  probability  matrix  "W  one  can,  by  employing  pre-  and  post¬ 
channel  pairs  with  matrices  and  7^  with  probability  fa  , 

obtain  a  channel  represented  by  the  matrix  Q  where 

Q  =  2T  2*  *<*  W  r*  (5) 

°< 

The  channel  characterized  by  W  includes  that  characterized  by  Q  , 
written  W  s  Q  ,  if  Equation  (5)  is  true  for  some  set  of  **  - 

7^  and  fa  .  Thus,  in  words,  W  includes  Q  if  vV  can  be 
made  to  behave  as  Q 


130 


RADC-TDR-63-147 


Fl««"  I  PROBABILITY  OF  ERROR  IN  BINARY 

INFORMATION  DIBITS  FOR  N  ORTHO¬ 
GONAL  TRANSMISSION  SISNALS  (FROM 
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If  W  3  Q  and  <5  2  W  ,  W  and  <3  are  said  to 
be  equivalent,  written  W  S  Q  .  This  is  a  mathematical  equivalence 
relation  and,  as  such,  partitions  the  class  of  all  transition  probability 
matrices  into  disjoint  equivalence  classes.  Channels  are  identified 
with  equivalence  classes  of  stochastic  matrices,  which  accounts  for 
property  (ii)  of  (4). 

Given  any  two  channels  A,  and  Aa  ,  if  A/  2  K2.  »  it  is 

reasonable  to  say  that  K /  is  at  least  as  reliable  as  A2  since  Kf 
can  at  least  duplicate  the  performance  of  ■  However,  this  in  itself 

does  not  completely  resolve  the  question  of  comparing  two  channels, 
since  it  is  possible  that  one  has  neither  K1  ="  A2  nor  A2  *2  A/ 
for  a  given  pair  of  channels,  i,  e. ,  neither  channel  includes  the  other. 

It  will  be  seen  that  this  is  exactly  the  case  for  the  binary  and  32-ary 
channels  considered  earlier  for  an  energy-per -information-bit/noise- 
power-density  less  than  about  -5  db,  whereas  for  values  greater  than 
this  the  32-ary  channel  includes  the  binary  channel. 


At  this  stage  the  channels  being  considered  are  quite  general, 
even  to  the  extent  of  having  different  size  input  and  output  alphabets. 

As  a  special  case,  consider  the  symmetric  channels,  which  are  defined 
as  follows.  A  channel  is  called  symmetric  if  for  some  A  and  some 
~p  the  equivalence  class  of  transition  probability  matrices  constituting 
the  channel  contains  the  matrix  P  =  [-fit's  ]  where 


-PiJ  ~  P 


i  =  J 


A  -  / 


/  f  J 


(6) 


(y  j  —  i,  2  j  *  •  -  /  /e . 

Such  a  channel  is  completely  specified  by  A  and  ^0  and  can  be 
denoted  Ckt_p  .  The  method  described  here  for  comparing  arbitrary 
channels  is  as  follows. 


Given  arbitrary  channels  K,  and  Az  let  ~pr  be  the  maximum 
for  which  Kt  —  CK  and  the  maximum  for  which 

A2  2  .  If  i>,  >  ,  then  A ,  is  more  reliable  than  for 

transmitting  K-ary  information.  In  terms  of  error  probabilities  this 
condition  is  <  /—  <-f>z  ,  Thus,  Kf  is  more  reliable  than 

A2  for  transmitting  K-ary  information  if  Kf  can  be  made  to 
behave  as  a  K-ary  symmetric  channel  with  a  smaller  probability  of 
error  than  is  the  case  for  A^  . 
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An  immediate  consequence  of  the  above  is  that  if  R,  includes 
K 2  ,  then  A,  is  at  least  as  reliable  as  Kz  for  transmitting  K-ary 
information  for  all  K  .  This  follows  from  Property  (iii)  of  (4). 


Consider  now  the  comparison  of  N-ary  systems  of  the  type  des¬ 
cribed  earlier,  with  error  probabilities  given  by  Equation  (1).  These 
are  symmetric  channels,  and  their  comparison  then  centers  about 
inclusion  relationships  between  symmetric  channels.  The  following 
result,  which  was  first  derived  by  Walbesser®,  is  concerned  with 
the  structure  of  Shannon's  partial  ordering  of  symmetric  channels. 


Theorem:  A  necessary  and  sufficient  condition  that 


I. 


s  c«>t 

R  *  N 


N,R  >t 


is  that  t  lie  in  the  closed  interval: 


N -f 


N 

R 


<  t 


N 


-7° 


N 


.  ,  (-*>  /V 


y 


ii. 


R  ±  N 


P  N  ^  ^  R  -/  A/  A/-R 

/V-/  R  *  N  -)  R'P  +  R(A/-  f  )  '  ~  N 


R-t  A/ 


N-R 


R-l 


_ Ji  ^ 

N-f  R  * 


H-R 
R(A/-t) 


<>  t  £ 


(7) 


A/-f  R  7  *  N 

(A  proof  of  this  theorem  is  given  in.the  Appendix.  )  This  is  a  minor 
extension  of  the  results  presented  in  RAD(3-TDRr63-134  in  that  symmetric 
channels  CN,P  for  which  ~p  <  are  also  considered.  The 

inclusion  relations  amongst  the  symmetric  channels,  as  determined  by 
the  above  conditions,  are  illustrated  graphically  in  Figure  2.  In  the 
unshaded  regions  neither  channel  includes  the  other)  In  what  follows, 
we  limit  ourselves  to  the  more  realistic  N-ary  symmetric  channels  for 
which  >  -L 


Let  us  now  compare  an  N^-ary  and  N£-ary  channel  with  respect 
to  their  ability  to  transmit  K-ary  information.  Denote  the  channels  by 
Cnn-pt  an<l  •  ^'or  P'  ^  ■  *  it  is 

readily  determined  from  (7)  that  i*  more  reliable 

than  if 

Nt  ?>2  <  N,  (8) 
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/> 


Figure  2  INCLUSION  RELATIONSHIPS  AMONGST 
THE  SYMMETRIC  CHANNELS  >  N) 


134 


RADC-TDR-63-147 


In  terms  of  the  error  probabilities  /-yv  >  f-j>z  •  (8)  takes 

the  form 


A/, 


<  1  - 


A// 


A. 

A/, 


(9) 


Note  that  this  result  is  independent  of  A  as  long  as  A  is  greater  than 
or  equal  to  both  N,  and  A4  .  In  particular,  for  Nt  =  32  and 
/V2  =2,  using  the  numerical  results  from  Figure  1  together  with 

Equation  (3),  it  is  found  that 

<  '  -  7t  +  1 TP‘ 

Thus,  the  32-ary  channel  is  more  reliable  than  the  binary  channel  for 
transmitting  K-ary  information  for  all  A i  32.  Figure  3  depicts 
the  situation  for  the  case  of  A  =  32.  The  curves  of  Pz  and  A3  a 
give  the  performance  of  the  systems  to  be  compared.  For  a  given  energy- 
per-information-bit/noise-power -density,  the  32 -ary  channel  includes 
all  32 -ary  channels  with  error  probability  lying  in  the  dashed  region, 
whereas  the  binary  channel  includes  those  32-ary  channels  lying  in  the 
shaded  region.  It  is  seen  that  the  given  32-ary  channel  includes  all 
32 -ary  channels  included  by  the  given  binary  channel  and  more.  This 
is  true  for  all  abscissa  values  shown. 


Suppose  now  that  K  £  N,  ,  Nz  .  It  is  readily  determined 
from  (7)  that  is  more  reliable  than  if 


N, 

N,-1 


or,  in  terms  of  error  probabilities, 


N, 

Nt  -  / 


% 


< 


A4  -/ 


/V* 


(10) 

(ID 


Again,  this  result  is  independent  of  A  as  long  as  A  is  less  than  or 
equal  to  both  A '/  and  Nz  .  Even  more  striking  is  the  fact  that  in 
the  notation  of  Equation  (3)  this  can  be  written 


p(",)  <  pfrl) 


(12) 


which  coincides  with  Wolf's  method  of  comparison  for  A  =2.  The 
result  here,  however,  requires  only  that  A  £  Nf  4  and  places 

no  other  restrictions  oh  fr/t  and;  • 
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Figure  3  INCLUSION  OF  32-ARY 
CHANNELS 
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Figure  4  depicts  the  situation  for  A/f  =32  and  -  2  and 

K  =2.  The  binary  channels  included  by  the  given  binary  channel 
have  error  probabilities  lying  in  the  shaded  region,  whereas  the  binary 
channels  included  by  the  given  32 -ary  channel  have  error  probabilities 
lying  in  the  dashed  region.  The  change  in  relative  performance  at  an 
abscissa  value  of  about  -5idb  is  evident. 


For  the  case  of 
is  more  reliable  than 

L  A 


K-1 


K- / 


hi,  <  K  < 


A4 

if 


it  is  found  that  C, 


'A£,  'fit 


a4-  / 


(13) 


which  indicates  a  dependence  upon  K  .  This  case  has  not  been 
investigated  in  any  further  detail. 


In  summary,  a  method  for  comparing  digital  communication 
systems  is  presented  which  (1)  encompasses  channels  represented  by 
arbitrary  transition  probability  matrices  between  input  and  output 
symbols,  (2)  relates  directly  to  Shannon's  partial  ordering  of  channels 
in  the  sense  that,  if  one  channel  includes  a  second,  it  is  at  least  as 
reliable  as  the  second  independently  of  the  size  of  the  comparison 
alphabet,  (3)  duplicates  Wolf's  results  for  the  special  cases  treated 
by  the  methods  in  his  note. 
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APPENDIX: 
PROOF  OF  THEOREM 


A  proof  of  the  result  (7)  is  given  here.  Define  a  pure  stochastic 
matrix  as  a  stochastic  matrix  whose  elements  consist  entirely  of 
zeros  and  ones.  Then,  given  any  rn  :by’  v  stochastic  matrix  P  , 
it  is  possible  to  express  P  as  a  convex  linear  combination  of  at 
most  'm(r)-t')  +  /  pure  stochastic  matrices  ,  i.  e. , 


A. 


p  =  £  «v  ^ 


>  <*)(  >  ° 


A, 


A  ± 


<=  / 


yn(7h- / + 


(A-l) 


To  prove  this,  let  P  —  [-p/y]  b$  any  w  by  7)  stochastic 

matrix.  Let  </<•  denote  the  column  index  of  the  minimum  non- zero 
element  in  the  row;  if  this  non- zero  minimuih  occurs  in  more 

than  one  column,  J i  may  be  selected  as  the  index  of  any  one  such 
column.  The  non- zero  row  minimums  are  then  the  -PiJ.  •  Let 


(a),  = 


mm 

t 


f  A*} 


and  let  P  —  be  the  pure  stochastic  matrix  defined  by 


Consider  the  matrix,  P~oO,  P 


0) 


(t) 

~P‘Ji 


which  differs  from  P 


(  )  elements,  in  which  case  the  elements  are 


=  /  . 
only  in  the 


*U 


—  (a).  St  0 


Furthermore,  at  least  one  of  the  -pcj-  —  <k),  is  equal  to  zero.  Thus, 
the  matrix,  p—  U),  P0'1  ,  has  at  least  one  more  zero  element  than 

P  .  In  addition,  the  row  sums  of  P—  oof  P( ^  all  equal'  f~  . 
Repeat  the  above  procedure  on  the  matrix,  P-  6e)f  P^'^  ,  to  obtain 


><2) 


and  consider  the  matrix, 


a  second  pure  stochastic  matrix, 

P —  tof  P{’ —  toi  P(z^  .  This  matrix  contains  non-negative 
elements,  has  at  least  one  more  zero  element  than  P-ui)/  P^'*  ,  and 

has  row  sums  all  equal  to  J  —  ft)/  —  .  This  procedure  is  repeated 

as  long  as  the  resulting  matrix  contains  a  row  with  more  than  one  non¬ 
zero  element.  Since  there  are  only  finitely  many  elements  in  the 
original  matrix,  P  ,  and  since  each  repetition  of  the  above  procedure 
produces  a  matrix  .with  at  least  one  more  zero  element  than  the  pre¬ 
ceding  one,  the  process  must  terminate.  Assume  this  occurs  after 
r-1  repetitions.  Then, 

P~  (to,  PU)-  PU) - -  ‘  —  60*,-/  P^'^  =  Q; 
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where  each  row  of  the  matrix,  Q  ,  contains  only  one  non- zero  element 
equal  to  f  -  a)t  —  (*z  -  •••  -  ^  Thus,  Q  has  the  form 

Q  =(t  -(t>f-(Oz - )P(*) 

where  P ^  is  a  pure  stochastic  matrix.  Setting  t  —  utt ••• 


pm  t»tp(,^+  a/4  P***  /  •**  «{*, 

where  the  ^  are  pure  stochastic  matrices  and  001  «  / 

Thus,  Z3  is  expressed  as  a  convex  linear  combination  of  the  above 
pure  stochastic  matrices.  The  maximum  possible  value  of  A*  is  attained 
if  each  repetition  in  the  above  process  produces  a  matrix  with  only  one 
additional  zero  element  and  if  there  are  initially  no  zero  element  in  p 
Therefore,  a.  <,  y»(v  - /)  +  / 


Consider  now  any  transformation  of  the  type  given  by  (5). 


L  9* 

If  each  and  7^  is  replaced  by  its  representation  as  a  convex  linear 
combination  of  pure  stochastic  matrices,  the  transformation  is  expressed 
in  a  form  involving  pre-  and  post-multiplication  of  P  by  pure  stochastic 
matrices  only.  Thus,  one  need  only  consider  transformations  with  the 
and  7^  pure  stochastic  matrices. 


The  stochastic  matrices,  P  = 
defined  by 


and 


A/®  +  » 

i=J 

N-1 

ifj 

VJ  -  *  • 

s 

'h 

/-  * 

“  *-/  * 

are  contained  in  the  symmetric  channels,  C#t 
We  are  interested  in  conditions  under  which 
equivalently,  P  2 


1 1  J  *  i$  •  •  • 


it  j  »  b  •  •  *  i 

f  and  4 
cn  p  *  c*,t 


*N 


R 


,  respectively, 
or, 
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To  determine  necessary  conditions,  assume  that  P  2  Q  Then 
there  exists  a  transformation  such  that 

2L  %  r*.  p  ^  -  q 

The  traces  of  the  matrices  are  related  as  follows, 

T .  3 U  Q  —  xt  (A-2) 

and,  thus 


~~  m/oi  i  A  (Ro<R^)  [•  ^  t1  ^ 

"  R«,  7<x  L  J  A  ^,7^ 


A  ^  ^  7c,  )  i 


(A-3) 


The  use  of  min  and  max  is  justified  by  the  fact  that  only  pure  stochastic 
matrices,  and  7^  ,  need  be  considered  and,  since  these  are 

finite  in  number,  the  minimum  and  maximum  must  occur  for  some  specific 
R^  ,  7^  pairs  in  the  set. 


Suppose  these  pairs  are  R  ,  T  and  K+  ,  r  ,  i.  e.  , 


min  i 

["  A.iR^pr^) 

|  =  a.  ( r  )  =*  a.  <2 

(A-4) 

max  J 

A  (/?«■  Z3  , 

jj-  =  &.{r+r  t+  )  *  A  <2f 

(A- 5) 

Q"  = 

R'PT~  > 

(A-4) 

Equation  (A-3)  is  a  necessary  condition  that  Ch,+  2  .  To 

show  that  it  is  also  sufficient,  assume  that  the  condition  is  satisfied, 
i.  e.  , 

~  A  Cf  &  t  £  A  Q*  (A-7) 

Let  represent  the  channel  containing  <3*  ,  and  consider  the 

transformation, 

R! 

21t  ~Z7  Rot-Q+Rc*  ~  v +  >  (A-8) 

<*r  /  A 
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where  the  /?„<.  range  over  all  permutation  matrices  of  order  R  . 
elements  of  are 


V- 


4  Q* 


si  —  J 


i-  f/R  Q* 
R  -/ 


t,  j  —  ?,  2 ,  -  •  *  R 


Now  p  2  by  (A-6)  and  Q*  s  Ut  by  (A-8).  Then  P  a  U  by 
property  (iii)  of  (4). 


The 


(A-9) 


In  an  entirely  similar  manner,  one  finds  that  P  s  U  where 

m'j  =7^' 

1  -  j/r  a.  q~ 

R-t 

i,d  =  /,  2,  •  •  •  v  R 

From  (A-7), 

$  oo  Q*"  R  (/  -  &)Q~  ,  0  on  &  f  ,  (A- 1 1 ) 

and,  by  a  result  of  Shannon4,  ^  2  <?  ,  which  demonstrates  that 

Condition  (A-3)  is  sufficient  for  2  C%jt 


(A-10) 


It  remains  to  explicitly  evaluate  the  minimum  and  maximum  con- 

and  consider  a  typical  element 


tained  in  (A-3).  Let  <3^' 
on  the  main  diagonal  of  <j?  , 


(=<■) 

fo-fc 

where 


N 

-L 

Vs/ 


V 


'W 


,h<) 

tjuk. 


-L 


t 


is  the  index  of  the  column  of  AL 


in  which  the 
is  to 


ii^<  th 


row 
select  out 


■y-k  --  -  __  ^ 

unity  appears.  The  effect  of  R*  ^determining  fkt 

the  1rk  row  of  P  .  Now,  let  be  the  set  of  row  indices  of 

corresponding  to  the  rows  in  which  the  K  th  column  unities  of  7o< 


appear. 
1.  2,  . 
empty. 


and 


Then 
.  ,  A/ 
Then 


jy  ,  J: 

into 


/  is  a  partitioning  of  the  row  indices, 


*  ) 

R  mutually  disjoint  sets,  some  of  which  may  be 


%U 


th.  Q 


-  2L  „  -fn  * 

v  (*■ )  V 

=  2-  flu  -Z 

*=  / 


z. 


/« 
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In  forming  Pi.  Q  ,  one  is  free  to  select  a  single  element  from  each 
column  of  P  ,  the  sum'  of  these  elements  being  A.  Q  .  In  addition, 
these  elements  can  be  selected  from  not  more  than  R  rows  since  the 
range  of  the  dummy  index,  K  ,  is  from  1  to  K  . 


For  R  A  N  ,  each  row  of  P  can  be  utilized  and  £*.  d*  is 
maximized  by  selecting  the  maximal  element  from  each  column.  If 
'■fi  >  1  then  '-p  X  t  f) ,  and  the  maximal  column  elements  lie 

on  the  main  diagonal  of  P  .  On  the  other  hand,  if-^9  <  1  / N  ,  then 

-p  <  (/--/oyW-f)  and  each  column  of  P  contains  N-l  maximal  ele¬ 
ments,  each  equal  to  (/- -p)/(F~i)  •  Thus,  for  Rk.bl 

TriMf,  fa  ®  /F  >  / / A/ 

=  A/  jp#  /F  ^o<  }/AJ 

If  '-p  -  ,  then  all  elements  of  P  are  equal  and 

( t \  Q  )  -  Alp  =•  Al  ~  —  f 

/  fa) 

To  find  mint  A  Q  the  argument  proceeds  exactly  as  above  except 
that,  in  this  case,  minimal  column  elements  of  P  are  considered. 

One  obtains 


j-  Hjtf 

—  N  -p 


"  i>*  i 
,F  -r*  v 


Thus,  for  R  >  N 


,  Equation  (A- 3)  can  be  written 


/  -vft  N 

N  -  t  R 


JL 

R 


*  '  *  ^R 

> 

IF 

M 

R  ’ 

IF 

which  is  in  agreement  with  the  first  part  of  (7)* 


Consider  now  the  case  of  R  ^  A/  .  The  above  argument  must 
be  modifiedin  that ‘only  R  rows  of  P  may  be  utilized  in  the  maximisa¬ 
tion  and  minimization  of  A  .  Thus,  one  must  select  a  repre¬ 

sentative  from  each  column  of  P  with  the  restriction  that  at  most  R 
rows  may  be  utilized.  In  maximizing  A  €t  ii  >  •fo  ,  each  of  the 
R  rows  can  contribute  one  Ip "  but  the  elements  taken  from  the  remaining 
R-R  columns  must  then  equal  On  the  other  hand, 

i ip<  -jp  , ,  maximization  is  accomplished  by  selecting  a  *  "  from 

each  column,  which  is  possible  since  R  >  i  .  Thus, 
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max 


Rjo  +  (U-R) 


and 


max 


*-  / 
A/ -I 


-Nj> 


{ 


A.  Q 


M 


N  -  / 


N-R 
N  -f 


IF 


*  >N 


IF 


^<7T 


Similar .  considerations 


elements  are 
On  the 


For  -jo  —  -jj  ,  these  maxima  are  identical 
apply  in  finding  min(2t.  .  If  >  Jf  ,  the 

minimal  column  elements  and  N  of  these  can  be  selected 
other  hand,  if  ^6  <  ,  the  P  5  are  minimal  column  elements  and 

only  R  of  these  can  be  selected,  the  remaining  N  —  R  column  repre¬ 
sentatives  necessarily  equaling  (  /  )  .  Thus, 

sf*)  1  _  t-_JL  -  -  -  * 


]  = 


A/ 


A!  -  1 


/F 


-P 


AJ 


Thus,  for  R  <  N 
l-p  _N 
N-1  R 

R-t  N 


AJ -R 


£  t 


A/-  /  ’ 

Equation  (A-3)  can  be  written 
R-f  A!  .  .  A/-R 


IF  P< 


t 

AJ 


^^7  ,F  ** 


N 


N-R 


<  6  < 


IzJL 


N -/  R  "f°  +  R (U-1  )  ~  ’  "  A /-I 

which  is  in  agreement  with  the  second  part  of  (7). 


/V 

R 


/R-p  6 


N 
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VII 


OPTIMIZATION  OF  DIGITAL  COMMUNICATION  SYSTEMS 
OPERATING  OVER  A  DISPERSIVE  CHANNEL 

OPTIMIZATION  IN  THE  FREQUENCY  DOMAIN 


SUMMARY 

This  analysis  is  concerned  with  optimization  in  the  sense  of  minimizing 
probability  of  error  of  a  digital  communication  system,  where  we  have  con¬ 
trol  over  both  the  transmitter  waveforms  and  the  receiving  system  but  not 
over  the  channel  transfer  function  or  the  noise  properties.  The  transmitted 
signals  are  assumed  to  occur  independently  and  with  equal  probabilities. 

The  energy  and  duration  of  the  transmitted  signals  are  specified.  The  noises 
added  at  the  input  and  output  of  the  dispersive  channel  are  assumed  gaussian, 
but  not  necessarily  white;  hence,  a  linear  receiver  is  used.  Matrix  Equations 
(10)  and  (11)  give  the  relationship*  which  must  exist  in  an  optimum  system 
among  the  signal,  receiver,  channel  and  noise  functions.  These  equations 
can  be  readily  solved  for  the  optimum  receiver  given  the  transmitted  wave¬ 
forms  and  vice  versa.  The  main  problem  is,  however,  to  optimize  both  the 
waveform  and  the  receiver  simultaneously.  For  a  particular  situation,  i.  e. , 
specified  channel  transfer  function  and  noise  autocorrelation  function,  the 
form  of  the  solution  is  obtained.  That  is,  series  expressions  for  the  optimum 
transmitted  waveforms  and  the  impulse  responses  of  the  receiving  filters  are 
developed.  The  coefficients  of  the  series  have,  however,  been  specified  only 
for  the  binary  case.  Interesting  orthogonality  properties  which  the  component 
functions  possess  are  developed. 

The  chapter  concludes  with  an  alternate  representation  of  the  probability 
of  error  based  on  geometric  concepts. 


INTRODUCTION 

* 

Figure  1  illustrates  the  system  to  be  analyzed. 


FIGURE  1 


*  This  system  was  previously  considered  in  Reference  1  where  a  time  domain 
analysis  was  employed  instead  of  the  frequency  domain  analysis  which  is 
used  here. 
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The  input  signals  are  time  limited,  i.  e.  ,  the  /,  vanish  outside  an  interval 
and  it  is  assumed  as  well  that  the  filter  functions  ur{  are  zero  for 
t  >  T  .  The  noises  n,  ,  nt  are  additive,  gaussian  with  zero  mean. 

The  filters  are  sampled  at  t  -  T  and  the  decision  made  that  ft  was 
sent  if  the  output  of  ur-  exceeds  the  output  of  each  of  the  other  filters.  In 
Reference  1,  an  expression  was  obtained  for  the  probability  of  correct  de¬ 
cision  Pa  as  a  functional  of  the  ,  tu'i  .  The  problem  was  posed  of 

determining  the  set  of  functions,  signals  and  filters  which  maximize  Pa  when 
24*5  and  the  noise  correlations  are  given  and  the  energies  of  the  signals 
limited.  A  set  of  necessary  conditions  on  the  ft  ,  -tu-'i  was  obtained  by  means 
of  the  variational  calculus.  These  conditions  had  the  superficial  appearance  of 
a  system  of  integral  equations  but  the  kernels  were,  themselves,  functionals 
of  the  unknown.  An  explicit  solution  was  then  obtained,  including  the  calcu¬ 
lation  of  Pa  ,  for  a  particular  ti/'0  and  noise  correlation  in  the  case  N  -  2. 

It  is  found,  however,  that  the  techniques  which  succeeded  for  N  -  2  were 
intractable  for  larger  N  . 

The  present  investigation  deals  with  the  same  set  of  necessary  conditions 
on  the  time  functions  ~U/{ >  ,  ft  .  By  replacing  these  conditions  by  equivalent 
ones  on  the  Fourier  transforms  and  operating  in  the  transform  domain,  we 
have  succeeded  in  finding  the  form  of  the  <c/£  ,  J ft  for  general  N  (where 

the  same  ttfo  and  correlation  as  previously  used  have  been  retained).  This 
is  the  main  result  and  is  given  in  Sections  2  and  3.  The  ft  ,  ttr£  are  found 
to  be  linear  combinations  of  functions  of  the  same  class  that  solved  the  case 
N  -  2.  But,  as  yet,  we  have  not  been  able  to  determine  the  coefficients 
which  complete  the  solution  for  N  >  2. 

In  Section  4,  some  orthogonality  relations  are  given  which  the  functions 
arising  in  Section  3  satisfy,  along  with  some  invariance  properties  of  the 
basic  equations  in  the  time  domain.  These  results  are  important  for  the 
construction  of  explicit  solutions  from  the  general  form. 

An  alternate  representation  is  obtained  in  Section  5  of  the  conditional 
probabilities  of  correct  decision  which,  in  some  respectB,  is  more  convenient 
than  that  given  in  Reference  1. 
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TRANSFORM  DOMAIN,  PRELIMINARY  THEORY 


We  consider  functions  of  a  complex  variable  of  the  form 

S( u)  -  C 


where  T  is  real  and 


Ct)+j6 

C  ,  JB 


are  real  or  complex. 


(1) 


Expanding  the  exponential  in  (1),  we  observe  that  the  singularity  at 
CO  =  -j3  is  removable.  Defining  <3(co)  by  continuity  at  this  point,  we 
have  that  G  (co)  is  entire.  It  is  shown,  as  follows,  that  the  IFT  (inverse 
Fourier  transform)  of  G(co ) 


C-trfa+je)  mf 


d  Cm) 


(2) 


vanishes  outside  the  interval  [0,7*]  ,  where  real  t  is  understood  and  when 

7*  is  negative  ( ' 0,  7~]  is  understood  to  mean  [  T,  0]  .  The  assertion  is 
evident  if  Tm0  .  For  7”>0,if  t  <  0  or  t  >7"  »  we  can  write 


a )+j8 


cL  Cm) 


(3) 


where  C  is  the  contour  consisting  of  the  real  line  completed  by  a  large  semi¬ 
circle  in  the  LHP  (lower  half  plane)  in  the  first  case,  or  by  a  large  semicircle 
in  the  UHP  (upper  half  plane)  in  the  second.  Hence,  q  (t)  vanishes  in  either 
case,  and  similarly  if  T  <  O  . 


For  any  function  of  the  form 
-  -<:  Too 

u,(co)  - 

we  define 


(a) 


~T  real 


(4) 

(5) 


i.  e. ,  the  CO  in  the  exponent  is  replaced  by  the  zero  of  the  denominator. 

And  for  any  linear  combination  of  functions,  U't  (CO)  of  the  form  (4),  we  define 


If  Ci 


(6) 
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f 


We  observe  that  the  function 


-irto 


c-lT* 

cat# 


has  the  form  (1)  and  that  any  linear  combination  of  such  functions, 
has  an  IFT  which  vanishes  outside  [  0,  7"J  • 


(7) 

T  fixed, 


If  R((ju)  m  N((m>) / b  (a>)  is  a  rational  function  for  which  degree  of  N  <  degree 
O  and  D  has  only  simple  zeros,  we  see  from  the  partial  fraction  repre¬ 
sentation  that 


e-i*>r Rfo)  -  ^e’la>T R(u>)\ R 


(8) 


has  an  IFT  which  vanishes  outside  [0,7"J  . 


In  evaluating  ,  it  is  not  necessary  to  operate  in  each 

case  with  the  explicit  partial  fraction  representation,  for  we  have  that  if 
,  i  =  1,  2,  ...M  are  the  zeros  of  D  then 


v  *'iTA  UMA 
(<*>-£d  Di  IS) 


(9) 


where 


Dc(cJ) 


b  Cud 


GENERAL  SOLUTION  OF  MATRIC  EQUATIONS  IN  TRANSFORM  DOMAIN 


Equations  (30)  and  (31)  of  Reference  1  gave  the  necessary  conditions 
that  the  probability  of  correct  decision,  Re,  ,  be  a  maximum.  These  may 
be  written  in  matric  form. 


V  h  (T-  rj  -\f(r)  *  Q 
(T-r)  -  r^r(v)  *  Q 


v  €  [Oy  T] 


(10) 

(ID 


where  y>  ,  ,  A  are  constant  square  matrices  and  fa  ,  J  ,  £  ,  £ 

are  A/  dimensional  vector  valued  functions  of  time  (column  matrices)  wnich 
are  distinguished  by  the  tilde  written  beneath.  The  transpose  of  V  is  indi¬ 
cated  by  >3  .  The  interval  on  which  (10)  and  (11)  are  required  to  hold  follows 

from  the  requirement  (which  we  impose  as  before)  that  the  //  signals 
and  the  /V  weighting  functions  U rj  vanish  outside  the  interval  [  0,  TJ  .  The 
vectors  h  ,  Q  ,  **  are  defined  by 


a  *  tira  #  /  * 
X  0 


*?t 

w0  *  4 

**£ 


(12) 
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(13) 

(14) 


h,  ~  tcr'a  *  US' 
r  -  jo  *  ur 

/v  S  A/ 


where  “Ufo  and  JO  are  the  channel  weighting  function  and  noise  correlation 
function,  as  in  Reference  1.  The  square  matrices  have  the  properties 


A  - 


(15) 


where  the  A/  are  Lagrangian  multipliers, 


-0  ,  A-r,  2,  ...  A/ 

(16) 

Tn  -0, 
l(* 

(17) 

(18) 

Since  ( 1 6)  and  (17)  imply  that  V  ,  are  singular,  it  is  convenient  to  make 
the  following  transformations.  Define  ,  y>0  by 

?  *  3‘  ^  (19 

9  ~  7>o  Jo 

(These  transformations  will  permit  us  to  modify  a  certain  matrix  product 
which  will  occur  subsequently  so  that  it  will  not  be  singular. ) 


where 


V 

• 

a 

1 - 

’1,0,0,  1  ' 

0,7,0, . 1 

0, 7,0,0  1 

0,  .0, 1,0,  •  •  *  -7 
• 

.  Jo  - 

0,0,10  1 
« 

• 

• 

0,0,0 - 1,-1 

«  * 

* 

0,0,0 . 1 

.  °1°1  ’  1 . 

(20) 


Then  7f0  ,  y>0  have  the  form 
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’  %>  %>"  '  0 ' 

fi/>  0 

*!«’>?»> '  *  *  ft,*-,’  ? 

fit  i  fit  >  *  ’  i  0 

» 

• 

}  *0 

*  * 

ft-,,,  *  ’  ’  ® 

>  t 

•  i 

0,0, . 0  _ 

_  f'Htr  *  tVtN-f.O  _ 

Upon  substituting  for  V*  ,  in  (10)  and  (11)  and  multiplying  the  resulting 
(11)  from  left  by  J0~f  ,  we  get 


1'h'(r-r)-K£k)  -0 

(22) 

%3  lr'r! 

r+J  * 

(23) 

where 


e.  g.  , 


P  ='J0h  sJ0ur0  *  ur  -tut  *  w-0  #  -us' 

£~J0r*J0p*ur=/>  *J0v? 


N-  + 


vS = 

o/ 


■UTf  -  tlTf. 

vj% 

U/~J  -  W'f. 


Writing  explicitly  in  terms  of  the  unknowns,  we  have 

-  -K  +  V  *0 


y0  (wi  *f)T_r  -  %(/>  *  nr')  r  •  o 


(24) 


(25) 

(26) 


(We  shall  at  times  for  convenience  indicate  arguments  of  certain  functions  by 
subscripts.  ) 
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Our  problem  is  to  find  real  functions  %</' ,  £  ,  when  wi  ,jO  are  given, 
which  satisfy  (25),  (26)  in  the  interval  [0,  T]  and  which  vanish  outside  this 
interval.  We  define  the  FT  (Fourier  transform)  of  a  real  function  w(t)  by 


U  (to)  *  J  t 

and  note  that  if  ur(t)  m 


a(t)cU 

u(T-6)  ,  then 


W  (to) 


e  -ttoT  v(oS) 


Let  the  left  sides  of  (25),  (26)  be  denoted  by 

ll(t)  *  y>0  (t^0  *ur')T_T  -  A/r  (27) 

■r(r)  S  y>0  (tu-  *  i)  r.r  -  f«s  (28) 


Using  the  convolution  theorem  together  with  the  property  just  noted  gives 


U(to)  -  H  (Wo  wje-‘*>r-\F 

(29) 

V(ou)~  Po  (K~f)  e'‘*>T-f0 

(30) 

where  the  bar  indicates  complex  conjugate  and  Wo  ,  ,  F  ,  $  are  the 

FT\ j  of  tv'o  ,  ur'  ,  £  ,  yO  .  We  may  now  rephrase  our  problem  as 

that  of  finding  £  ,  J W'  so  that  the  IFT's,  £  ,  are  real  and  vanish 

outside  [0j  T]  while  the  IFT’s  ,  "Vf  of  (27),  (28)  vanish  inside  [0,  Tj  . 

Let  us  take 

F  *  Kf  y>0  e'^r  FT  '  K  e’1**7"  H'\r  (31) 

where  t£  -  and  the  operator  [•]*  applied  to  the  column  matrix 

means  that  the  operator  is  to  be  applied  to  each  element.  It  is  understood 
that  we  shall  subsequently  take  in  a  form  consistent  with  Section  2.  Then 
£  represents  (if  the  FT  of)  a  function  f  which  vanishes  outside  [0,7^ 
This  does  not  yet  make  f  real,  but  we  note  that  since  US^  is  real,  f  will 
be  real  if  to^[_  is  real.  We  use  here  the  criterion  that  the  function  represented 
is  real  if  ~W  (u>)  »  W(-Cu)  .  Applied  to  (31)  together  with  the  fact  that  CO* 
commutes  with  conjugation  and,  also,  with  sign  change  of  (to>  ,  we  have 

£  *  att  ve  e  itur  H'  -  K1  Vi  [e‘,<»TS?% .  (32) 
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Then 


%  e'lv>r  W0£  -  %  W0  W0  (H‘-  t  '*tor  W^rH\ ]J-  (33) 

and  so  (30)  can  be  written 

y(v)  ~(?0  A'r  V0W0W6-  y0  §)  w'~  ?0  vVo  e  r  M4  .  ( 34) 


Now  the  elements  of  the  last  row  and  column  of  the  matrix 

f  -  Vo  A-'V0  (35) 

are  all  zeros.  We  define  tfT0  as  the  (a/-i)  by  (tf-l)  matrix  obtained  from 
Tp  by  deleting  the  last  row  and  column,  and  we  denote  by  7J  the  (W-l)  by 
(/ V~1 )  matrix  obtained  from  >po  in  the  same  way.  Putting 

JT%.  <36> 

(the  existence  of  the  inverse  may  be  assumed),  we  have 

y~K  [(Vo  &of-Y0)w'-  e-^Tiv*  (e^TWc  ]#')*].  (37) 


We  now  take  W'  in  the  form 

w'-  -  e-^r[e^T^]^  ,  T>  O  (38) 

where  W».  will  subsequently  be  taken  in  the  appropriate  rational  function  form. 
Writing  (38)  as 

W'=  [jfr  e‘<^-  (e«vrjvj«]  e~Cu>r 

we  see  by  Section  2  that  the  square  bx*acket  represents  a  function  which  vanishes 
outside  [-7-,  0]  and  so  W/  itself  represents  a  function  which  vanishes  outside 
[0,  rj  .  Using  (38),  y  becomes 

V  ~  &\(W,  W0I -Y  $)  W*  -  (W^W.I  -  Y  §)  e-^T  (39) 

-c'^r  W0  [e‘WV,(y«.  -  IV.  (V*>r^jJ  1  . 
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We  have  to  find  so  that  jtf*  represents  a  real  function  and  1}  ,  V 
represent  functions  which  vanish  in  [0,  T]  .  To  illustrate  the  technique 
that  may  be  applied  to  this  end,  we  consider  the  case 


Wo 


4. 

CL  +  i  Cm) 


(40) 


§  ((e))  = 


%  cl* 

4**  (JO*- 


(white  noise  at  input  &  output  of  <ju0  )  (41) 


The  first  term  of  (39)  is  (except  for  the  matrix  factor  1j70  which  will  be  seen 
to  be  inessential  to  the  following  arguments  concerning  the  vanishing  of  Us  ,  If' 
in  [0,  T ]  ) 


where 


7  '  iOK 


Wo  Wo  Wo. 


Wo  Wo 

Let  Wo,  be  such  that 
Wo  Wo 


(jO  a 

n,  —  *  /?,  *  h,  t 

CL1  1  L 


Wo  Wo  Wo,  *  b  Wa 

where  b  is  a  constant  vector. 


(42) 


(43) 


Then 


=  Wo 


1 


(44) 


Since  Wo  represents  a  real  function  which  vanishes  for  negative  &  ,  W0 
represents  a  real  function  which  vanishes  for  positive  t  and  therefore  in 
particular  vanishes  in  [0,  7~J  .  Because  of  (43),  each  component  of  tht 

first  term  in  the  curley  bracket  of  (39)  vanishes  in  [0t  T]  .  To  complete 
the  requirement  that  vanish  in  [Ot  T J  »  we  shall  choose  the  second  and 
third  terms  of  (39)  so  that  their  sum  has  no  pole  in  the  LHP.  For  the  example, 
there  is  a  pole  in  the  LHP  at  av^-icu  and,  in  a  moment,  we  shall  impose  the 
condition  that  the  residues  of  these  terms  cancel.  At  the  same  time,  we  shall 
satisfy  the  requirement  that  U  vanishes  in  [0 1  T] 

Let  Zi  be  the  roots  of  the  polynomial 

\rSi-i\-o  (45) 
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i.  e. ,  the  £/  are  the  reciprocals  of  the  eigenvalues  of  V  .  We  assume 
that  the  £/  are  distinct  so  that  we  may  use  the  representation  for  a  function 
of  a  matrix 

*•1/1  i 

f,y)-p(- tJs'  ,46) 

where  the  are  the  resolutions  of  the  identity  (projection  operators)  which 
have  the  properties 


eitj'Oy  L+j 


6*  -  €{  C  -H-7 

H-t 

*/  • 

(For  an  arbitrary  vector  X  ,  the  matrix  operation  tf^X  projects  X  onto 
the  subspace  spanned  by  the  eigenvectors  associated  with  the  eigenvalue  £*/.  ) 


Thus,  by  (46),  we  may  write 

Af-1 


Hence,  from  (44) 

y  H-t  0 


(47) 


From  (42) 


and  since  the  £(-  are  constant,  we  may  introduce  new  constants  fit  by 

UlUIlZ.  —  "J^L  #  (48) 


Thus, 


& 


&  -  -  a(a,rtGo)£  Jtf&i-js*)  •  <4»> 

With  the  use  of  Section  2  and  the  linearity  of  the  operator  ,  we  have 
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(50) 


e  f 

-2/&i 


[e'“T*], 


cl  r  j&  e<4'r  a.-l&i  e-^cT 

(a) -A  2/Si  <4>+j6i  -ZAi 


(51) 


; 

cu-Ac 


e‘4'r  7  e~lAr 

2  A  (O  tAi  -Z/3i 


(52) 


CL  LjSi 

e‘*r  cl-lAc  e~{*r 

Q.i  -Ac 

2  Ac  ~2&i 

Hence,  the  third  term  in  the  curley  bracket  of  (39)  is 


-erie*rWc 


/ 

CL+  iCC 


2-A;  ' 


e-<Ajr\ 

7 


(53) 


We  observe  that  the  term  in  the  Bquare  bracket  of  this  egression  is  just 
Q  ( cu)  from  which  it  follows  that  0,  vanishes  for  all  positive  t  and, 

therefore,  in  particular  for  66  [OyTj  .  For  the  second  term  of  (39),  we 
have 


-e 


'lvrrWa 


ut  iaJ 


cl-lAj  e."ifijr 

-Z£j 


(54) 


Since  £jfy-0  ,  J  ^  A  ,  the  last  expression  becomes 

-e-^Tw0w0 


% 


*jk 


CL  /  i/$J  €  lAjT  ^  u.-  C/Qj  e 
(0-/8 j  ZAj  +  (Oi-Aj  -2/Sj 


(55) 
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For  the  condition  on  the  residue  a,  we  get 

N-1 

9 


~ —  *'£ 


3- *  a 

+£,*%■  VA® 

r  nz  '  i  / 


A 

e  iaJT 

-  <4 

e'iAT 

Si 

"W  * 

-a.c+dj 

-tflj 

rr\ 

'e  0JT 

e-WjT 

\  l  / 

<Vi 

I 

2 A  _ 

*  0  . 

■v 

(56) 


m^tbe'zeri  Tjc’!™''  'hi*  <»*<  «>.  "efficient  of  each  tJ 


•**']  *  &  +(•<*'-, «*r) 
-  7  ^^£s£il>  f e4*r.e^r). 


Simplifying 


-  e-^yr 


n,  a* 


+  <2* 


(<#  +  4?)  ±,  ~  ^ 

*  -  i  / 


a.  -i1  c'4' 


n.a*- 


n,  ar 


Qti&jT m  2±  +  *  +*?+(*■ -1 4/?  _  ~7}T+Zclk-2Uj8j 

*  **>‘4’*  f  (*.*l£jf  ZujSj 


W,  «-* 


e 


->7^  7^/7*' 


fy/a* 

1+2. 

2  nA 


Hence,  we  have  arrived  at  the  condition 


Aj/CL  (57) 
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which,  in  view  o£  (48),  is  a  condition  imposed  on  the  eigenvalues  of  7  . 

Since  we  assumed  distinct  eigenvalues  for  7  ,  we  have  to  choose  distinct 

roots  of  (57)  (the  case  for  degenerate  eigenvalues  needs  further  investigation). 

Collecting  the  result  for  77'  »  we  repeat  here  equations  (38),  (49),  (51) 


/V-r  *  . 


,-Za. 


a.  c*  A* 
to  A 


e  l^iT  cl  -  jj8i  7 

ZjOc  go  +j6>i  -Zj6l 


(58) 

(59) 

(60) 


If  we  deal  with  real  solutions  of:.  (57),  it  is  clear  from  the  last  equations  that 
whether  -ur'  can  be  made  real  depends  only  on  whether  we  can  find  the  approp 
riate  constant  vector  b  .  This  completes  the  construction  in  the  transform 
domain. 


Let  us  carry  the  results  back  to  the  time  domain  and,  then,  we  shall  summarize 
what  has  been  found.  We  have  in  connection  with  W*. 


JFT  {- 


(cl  +  <  f 


at  c  Cl) 


Inf  /  to* -A' 


e  iayr  cC  (a)  *  I . 


(61) 


We  have,  by  Cauchy's  theorem  and  the  usual  understanding  of  the  meaning  of 
an  improper  integral  of  the  form  I  (that  is,  we  are  taking  real) 


•/  * 


Zrei 


<■  g  Coot 


to*  -a* 


cL  (jl>  •*  ) V,  res. 


(62) 


where  the  contains  shown  in  Figure  2  are  for  t  >  0 
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-CD 


c,  C. 

>  C\  .  CA  ,  v 

-A  0  ~4r 


CO 


FIGURE  2 


Thus,  since  the  integral  over  C5  vanishes 


il 

and  so 

ifaZ  t  A 


±zJ£i  e-LA*  -/  —  *  C-/S<  e.lAt 
-z  Ai  ZA  1 


/ 


Zj6c 


sen  (^Ait  -t  tan'1  -Q-  J 


t  >  0 


(63) 


For  t  <  0  ,  C3  is  taken  in  the  LHP  which  results  in 


/  -  -^LlR  sinUt  + 

Z/Si  \  & ' 


so  that 


*  -  -Ebb  ^0-slnb  *  ■ 


Similarly,  we  find 


1  lA  e  UBi(U  t)  + 


2  A 


'“CO 

Hence,  the  IFT  of  the  second  term  of  (58)  is 


e-A(t+T) 


(64) 


(65) 


(66) 
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Combining,  we  have 

/  y*  €<  -^L  i £Lz+/i*  sin  (/S(t  +  tan'1  — ) ,  0  •<  t  4-T 

0,  elsewhere 

Evaluating  h'  (t)  •  Uf0  ■*  -tv*'  gives 


M-1 


A  €i6' 


h'(t)  -Z  ~  UnA*. 


A  Oi 


From  Equation  (25) 


f  (t)  ~Z  T  -  A  U-T)  . 

i  "<■  nt 


(67) 


(68) 


(69) 


In  summary,  what  we  have  obtained  in  the  present  section  is  that  the  solution 
vectors  ur' ,  £  are  respectively  linear  combinations,  Equations  (67),  (69), 
formed  from  the  sets  of  functions 


Sin  (Si  t  +  tan ,  sir)  Jii  (t  -T) 


(70) 


where  the  A  are  solutions  of  (57).  The  result  is  valid  for  general  /V  ,  The 
difficulty  in  passing  from  the  general  form  oi  the  solution  to  the  explicit  solutioi 
i.  e. ,  choosing  the  appropriate  A'  an<*  k,'  *  i®  *hat  (48)  has  to  be  satisfied. 

The  difficulty  is  greatly  diminished  in  the  case  /V  =2.  For,  then,  (67) 
becomes  simply 


tin/  sr  ur,  -  wz  '  A  sir?  fat  +  tan' 

where  h  is  a  constant.  And,  then,  (68)  and  (69)  become 

I/(l  )  ,,  sln  jS  t 

fo+jtt? 


(67') 


(68' 


m 


K-’  V.  sin  A(t  -T). 


(69' 


The  last  three  equations  are  identical  with  (58),  (62),  (59)  of  Reference  1, 
while  our  present  equation  (48)  is  just  the  previous  condition  (54).  Thus,  in 
the  case  //  =2,  we  may  show  just  as  we  did  before  that  (48)  is  satisfied. 
But  for  /V  >  2,  we  have  not  as  yet  obtained  an  explicit  solution. 
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In  the  next  section,  we  present  some  orthogonality  properties  of  the 
functions  (70)  together  with  some  general  properties  of  the  basic  vector 
equations  (10),  (11).  Such  properties  are  important  for  the  completion  of 
the  solution  for  N>  Z  . 


PROPERTIES  RELATED  TO  THE  SOLUTION  OF  THE  MATRIC  EQUATIONS 
(a)  Orthogonality  Properties 

We  give^  below,  two  important  orthogonality  properties  of  the  sets  of 
functions 


h{(t)  -  sin  Ai  t 

(71) 

(t)  *  sin  t  +  tan~f  , 

(72) 

Ai  are  solutions  of  the  equation 

u  4  -r  ■  2.  n»  At 

tan  At  T  - - —  -  . 

+  2  n,  <l 

(73) 

We  may,  without  essential  restriction,  take  the  Ai  positive  and  label  them 
At  ,  ,  Aa  . in  increasing  order  of  magnitude. 


The  results  are 


J hi  (t)  hj  (t)  dt  *  0,  C  4  j 

J  J ' tV'i  (u.  -  7s)  d  U.  dv'  -  0)  i  +j 


(74) 

(75) 


where 


jo(t)  «•  nz  <f(z)  /  nf  (76) 

Equation  (76)  is  just  the  correlation  function  with  which  we  have  been  dealing 
all  along.  It  is  conjectured,  however,  that  the  orthogonality  properties  corres¬ 
ponding  to  (74)  and  (75)  will  hold  in  more  general  circumstances.  The  proof 
of  (74)  is  immediate  on  substituting  (71)  and  using  (73),  The  proof  of  (75)  is 
also  a  straightforward  calculation,  only  lengthy. 
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(b)  Invariance  Properties  of  the  Matric,  Vector  Formulation 

It  may  be  verified  from  the  definitions  of  \?  ,  ff  in  Reference  1 
report  that 


.  (JPc) 


(77) 


/  dPe.  \ 

By  a  notation  of  the  form  I  —  I  ,  we  shall  always  mean  the  matrix  whose 
ij  element  is  the  indicated  quantity  bearing  the  label  ij  . 

The  matric  equations  (10),  (11)  of  Section  3  may,  therefore,  be  written 


We  consider,  now,  that  a  complete  energy  matrix  has  been  specified.  That  is, 
that  we  are  required  to  satisfy 


[f  (t)4  (t)  cU  =E 


(80) 


where  the  square  matrix  E  is  given.  This  is  a  deviation  from  the  situation 
considered  previously  where  E  was  a  diagonal  matrix,  but  the  basic  equations 
(10),  (11),  Section  3,  remain  unchanged,  except  that  "K  is  no  longer  diagonal. 
Substituting  (78)  in  (80)  gives 


\  &  fnnJ 


iXF 


(81) 


where  ff)  is  the  transposed  mean  matrix.  Substituting  (81)  in  (78),  we  have 


(82) 


y 


Consider  the  transformation 

Af -f  ,  i 

<v  /v  /V  (V 

A  ur  -  SP ,  tu^=  A 


(83) 
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m 


y 

where  A  is  an  orthogonal  matrix.  Under  this  substitution,  the  matrices 

•  m  correspond  to  the  new  matrices  m  ,  M  , 
We  find  the  relation  between  them  as  follows: 
fn  x  ur0  *  f  *  tv-  *  #  Af  «  tv- A  -  Auk  *  -ur  A  m  A  m  A  .  (84) 


(d  Pc  ) 

(dPc  ) 

[Tftyj 

‘  Ujty  I 

And  similarly, 

M -  AM A  . 


For 


From  (84) 

Srnij 

and  substitution  in 


,  we  have 


d  Pc 
dmij 


-  Am  Aji 

(86)  gives 


9  Pc 


d  mAi 

d  7*  ij 


Similarly, 


Collecting  results,  we  substitute  the  following  in  (79),  (82) 
f  -  A£  ,  -US'  -  /4  ,  tn  m  AM  A  ,  AA  *  A  /A  A 


This  gives 


'£ 

*  c 


(85) 


(86) 


(85) 

(86) 


(87) 


*  We  have  used  the  definitions  of  m  ,  M  given  by  Equations  (2),  (6)  of 
Reference  1. 
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where  E  m  AEA  . 


Thus,  if  £  ,  solve  the  system  when  E  is  given,  then  £  A£ 

HE  s  ^  US'  8°lve  the  system  when  E  s  AEA  is  given. 

We  consider  next  the  substitution 


(88) 


(89) 


Substituting  in  (79)  and  (82),  the  equations  are  unaltered  and  we  conclude  that 
**  t,  >  IE*  8olve  the  system,  so  does  £  ,  .  Moreover,  we  deduce 

easily  from  the  representation  of  Pi  given  in  Equation  (91)  of  the  following 
section  that 

Pc  (m,  M)  *  Pc  (’km,  k*Al) 

where  it  is  recalled  that 

Ec  -  2L  Pi  Pi  • 

Hence,  -ur  is  arbitrary  to  a  multiplicative  constant  and  different  constants 
give  the  same  Pc  . 


AN  ALTERNATE  REPRESENTATION  OF  CONDITIONAL 
PROBABILITIES  OF  CORRECT  DECISION 

A  contour  integral  representation  of  the  conditional  probabilities  of 
correct  decision,  P;  ,  was  given  in  Equation  (14)  of  Reference  1.  It  was 
obtained  by  use  of  the  characteristic  function  of  the  normal  distribution  and 
was  valid  for  an  arbitrary  number  /V  of  signals  and  weighting  functions. 

We  shall  obtain  directly  here  an  alternate  representation  which,  in  some  re¬ 
spects,  is  more  convenient  than  the  previous  one.  We  shall  discuss  it  relative 
to  the  case  A/  =  3,  but  it  will  be  evident  that  the  essential  arguments  are  valid 
for  any  /V  . 
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For  /V  =  3,  the  conditional  probabilities  of  correct  decision  are 


P,  *  P  >  *3  |  ff  sent) 

Fi.  *  P  (*1>  *1 ,  **><i $  \A  sent)  (90) 

Hm  P  (*s  >*n  |  h  sent)  , 


For  the  first  of  these,  we  have 


P< 


-Zb-Mt)/*'1  (%-*»,)  cl%,cLxt  cL%i 


(91) 


where 


and 


tof  is  the  moment  vector  (column  matrix)  when  ff  is  sent 
M  is  the  moment  matrix 

S  is  the  subset  of  £%  which  is  bounded  by  the  planes 
Xl  -  XK  *  0  ,  'Xi  -  -  O 


and  contains  the  point  ,  (For  convenience,  we  have  dispensed  with  the 

tilde  used  elsewhere  to  distinguish  column  matrices  or  vectors.  )  By  a  pre¬ 
liminary  translation,  we  get 


e  dx,  dxt  dXj 


w  f  » 

where  a  now  contains  the  origins  and  is  bounded  by  the  planes 


'Pf  -  **  +  ">»  - r”tt  m  0  (92) 

di  -*3  +  -mu  ’  0 

Since  M  is  positive  definite,  we  may  make  the  substitution  (Reference  2) 

X  *  M*X'  (93) 


and  obtain 


where  S"  is  the  image  of  S'  under  the  transformation 
ient  to  write  the  planes  (92)  in  the  more  general  notation 


Af*  . 


(94) 


It  is  conven- 
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o 


(95) 


'd.%  -t  mf1  -wtt  - 
%  +  »rf/  -  ty>n  -  o 

where,  in  the  present  case, 

*■-(-!)>■  h  m(s)-  1961 

Under  the  linear  substitution  (4)  the  planes  (6)  transform  into  the  planes 

K  X  +  -  mu  *  0 

b't  +  n)f1  ~tnn  -  0 

where  __ 

M,  «  3.  ,  b  -  bM%  . 

Since  is  symmetric, 

3  “  Z/t^A.  .  o  ~  A1y*  b  - 


(97) 


(98) 


There  is  an  orthogonal  transformation  T  which  carries  the  line  of  intersection 
of  the  planes  (97)  parallel  to  the  s  axis  (in  fact,  there  are  an  infinity  of 
such  transformations,  any  one  of  which  will  do  for  our  purposes).  Introducing 
in  (94)  the  change  of  variable  (/  *  gives,  since  |  ciet  f  \  •  1 , 


(99) 


where  S'"  is  a  cylinder  set  parallel  to  .  Hence,  we  may  integrate  out 

and  obtain 


H,  >  ~  e‘*  &  '  to)  <j.yf  d<jt  (1 00) 

% 

where  S*  is  a  subset  of  the  plane  which  may  be  described  as  follows.  The 
distances  from  the  origin  to  the  planes  (97)  and  the  angle  between  them  are 
given  by 


' '  dr*)* 


/  >rhi  -  Mrs 

d‘  (U)& 


cos  6 


tl 

asD*  diY- 


(101) 
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These  quantities  are,  of  course,  invariant  under  orthogonal  transformation  and, 
therefore,  (101)  gives  the  distances  to,  and  the  angle  between,  the  lines  which 
bound  St  .  Using  (98)  in  (101)  gives 


<*, 


(Z/Va.)* 


< 


-  mn 

(£M6)t  ' 


cos  & 


ZM6 


(102) 


so  that  the  parameters  which  describe  Sz  ,  and  therefore  Pt  ,  are  expressed 
simply  in  terms  of  linear  and  bilinear  forms  with  matrix  M  .  Thus,  with  the 
use  of  (96),  we  have  finally 


j  ,  pt%  - 

1  ^An  -Z-An+A"  )f'  *  1  (a*  ~zAn  V'jJ* 

cos  O  »  yU'ri  ~/U’rt  ~  +  A-ts _ 

(jU-rr  ~  *  (An  ~  ZAij 


(103) 


where  the  yUij  are  the  elements  of  A1  .  Similarly,  for  and  /J  ,  we 

have 


<C- 


-  cCtt  /<*) 

{Me  -ZyUn  +JJ-o)1k  ’  * 


(104) 


/<*> 


-  m 


•/ 


(Aj,  "  ZAf  * 


(At*.  ~  ZA**  *  A-3s)*- 


(Ass~zAu  +A-*x)% 


cos  &60- 


_ A -A 3*  ~A  nr  +A  tj _  Cos  glVm  '~~JJ  ’s~Mr _ 

6Ku  ~ZA»  ’f‘J^n)Jk(Af*-ZAa  *  CutflMn tA")*(A*~ZA*tA**yi 


„(U  Ass  ~Av~Asz  TAaf 
Cos  a  •  3 


A  convenient  formula  for  computation  of  the  P‘  *s  for  /V  *  3  has  been  obtained 
from  (100),  (103),  (104)  while  further  work  iB  needed  to  obtain  a  computational 
form  for  larger  /V  . 
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VIII 

RECOMMENDATIONS  FOR  FURTHER  INVESTIGATIONS 


1.  Maximum  Likelihood  Reception  of  Frequency  Modulated  Signals 

This  investigation  should  be  extended  to  include  operation  near  and 
below  the  FM  threshold.  If  the  results  obtained  are  superior  to  those 
obtainable  by  other  means,  such  as  FMFB,  then  means  of  implementing 
maximum  likelihood  FM  receivers  should  be  investigated. 


2.  Threshold  Performance  in  FM  Systems 

In  Chapter  III,  the  threshold  characteristic  of  an  FM  receiver  con¬ 
sisting  of  a  limiter -discriminator  followed  by  a  minimum  mean-square -error 
postdetection  filter  {Wiener  filter)  was  investigated.  The  modulation  function 
was  assumed  to  be  a  gaussian  random  variable  which  made  the  determination 
of  the  required  IF  receiver  bandwidth  rather  difficult  and  somewhat  arbitrary. 

It  would  be  desirable  to  extend  this  work  to  include  other  forms  of 
modulating  functions,  the  statistics  of  which  would  be  closer  to  those  of  signal 
functions  encountered  in  practice.  It  is  suggested  that  a  similar  analysis  be 
carried  through  for  a  band-limited  modulation  function  having  a  uniform 
distribution  of  amplitude  over  a  given  range.  This  would  be  more  repre¬ 
sentative  of  practical  situations  and,  also,  would  lead  to  a  better  defined 
bandwidth  of  the  transmitted  signal.  This  would  also  allow  the  results  of 
the  FM  analysis  to  be  compared  with  the  PCM  analysis  in  Chapter  V. 

The  work  in  Chapter  HI  considered  only  the  effects  of  the  additive, 
white,  gaussian  noise  source  in  determining  the  output  signal -to -noise  ratio. 
The  noise  power  and,  hence,  the  position  of  the  threshold  is  quite  dependent 
on  the  IF  bandwidth  selected.  Thus,  from  the  standpoint  of  reducing  noise 
(and,  hence,  threshold),  it  would  be  desirable  to  reduce  the  bandwidth;  how¬ 
ever,  any  reduction  in  bandwidth  is  accompanied  by  increasing  distortion  due 
to  truncation  of  the  IF  signal  spectrum.  This  work  should  be  extended  to 
establish,  quantitatively,  the  most  desirable  IF  bandwidth  in  order  to  optimize 
over -all  performance  when  considering  both  the  additive  noise  and  signal 
distortion  effects. 
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3.  Use  of  Information  Theory  to  Bound  the 

Performance  of  Communications  Systems 

The  bound  derived  in  this  report  is  on  the  ratio  of  signal  entropy 
power  to  mean  square  error  in  terms  of  channel  capacity.  This  result  has 
two  serious  shortcomings.  First,  we  do  not  know  how  to  attain  the  bound, 
but  anticipate  that  a  close  approach  to  the  bound  would  entail  a  very  lengthy 
coding  procedure.  Secondly,  the  practical  significance  of  a  bound  on  the 
ratio  of  signal  entropy  power  to  mean  square  error  is  not  immediately 
apparent.  With  regard  to  the  first  point,  one  may  be  able  to  obtain  bounds 
for  codes  of  finite  complexity  by  proceeding  in  a  manner  similar  to  that 
outlined  in  Chapter  V. 


4.  Investigation  of  Transmission  of 

Analog  Data  Over  a  Digital  Channel 

Further  consideration  should  be  given  to  the  selection  of  the  performance 
criteria  (S/N,  MSE,  etc.  )  in  terms  of  the  system  application. 

A  comparison  should  be  made  with  conventional  analog  systems  (e.  g. , 

FM  and  FMFB)  to  establish  the  relative  merits  of  analog  and  analog -digital 
systems  as  a  function  of  channel  parameters,  bandwidth -expansion  factors, 
required  average  power,  etc. 

The  investigation  of  the  effects  of  different  error  distributions  should 
be  continued.  The  distribution  of  the  digital  errors  may  be  manipulated  in 
several  ways;  for  instance,  in  a  PCM  system,  different  energies  may  be 
assigned  (by  varying  the  duration  or  amplitude)  to  the  various  bits  of  a  code 
word.  The  ability  to  alter  the  error  probabilities  may  be  exploited  in  a 
manner  akin  to  predistortion  of  analog  signals,  such  as  pre  -emphasis  in  FM 
systems.  Theoretical  bounds  for  such  systems  with  nonuniform  error  proba¬ 
bilities  need  to  be  developed. 

The  system  performance  when  an  analog  signal  is  transmitted  by  a 
digital  system  over  a  fading  channel  should  be  investigated,  and  a  comparison 
should  be  made  with  direct  analog  methods  operating  over  an  equivalent  channel. 
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5.  Optimization  of  Digital  Communication*  Systems 

Operating  Over  Dispersive  Channels 

By  system  optimization  is  meant  the  simultaneous  specification  of 
the  transmitted  waveforms  and  the  receiver,  so  as  to  obtain  the  minimum 
probability  of  error  under  the  given  restraints. 

The  entire  solution  to  this  problem  has  not  yet  been  obtained  even 
for  the  simplest  cases  considered,  except  for  the  case  N  =  2.  The  present 
state  of  affairs  can  perhaps  best  be  summed  up  by  stating  that,  for  a  known 
channel  transfer  function  and  noise  statistics, 

a.  given  the  set  of  transmitted  signals,  the  best  receiver 
configuration  can  be  determined,  or 

b.  given  the  receiver  configuration,  the  best  set  of  signals 
to  transmit  can  be  determined. 

Although  we  have  expended  considerable  effort  at  attempts  to  obtain 
simultaneous  optimization,  we  have  so  far  not  been  successful.  This,  there¬ 
fore,  remains  an  open  problem.  It  is  noted  that,  in  the  radar  field,  a  great 
amount  of  effort  recently  has  been  devoted  to  signal  synthesis.  Many  valuable 
results  have  been  obtained,  although  no  real  optimum  has  been  found.  There¬ 
fore,  it  seems  reasonable  to  expend  further  effort  at  improving  system  per¬ 
formance  even  if  the  optimum  remains  elusive  for  the  present. 
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